-- Logs begin at Tue 2021-10-19 07:45:22 UTC, end at Tue 2021-10-19 08:45:44 UTC. -- Oct 19 08:15:47.252182 dv-cinder-813984-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 19 08:15:47.260922 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 19 08:15:47.263566 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 19 08:15:47 2021] *** Oct 19 08:15:47.263566 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 19 08:15:47.263566 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 19 08:15:47.263566 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: nodename: dv-cinder-813984-3-iscsi Oct 19 08:15:47.263566 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: machine: x86_64 Oct 19 08:15:47.263566 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: clock source: unix Oct 19 08:15:47.263566 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: pcre jit disabled Oct 19 08:15:47.263566 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: detected number of CPU cores: 4 Oct 19 08:15:47.263566 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: current working directory: / Oct 19 08:15:47.263566 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: detected binary path: /usr/bin/uwsgi-core Oct 19 08:15:47.263566 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: your processes number limit is 47680 Oct 19 08:15:47.263566 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: your memory page size is 4096 bytes Oct 19 08:15:47.263566 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: detected max file descriptor number: 2048 Oct 19 08:15:47.263566 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: lock engine: pthread robust mutexes Oct 19 08:15:47.263566 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: thunder lock: enabled Oct 19 08:15:47.263566 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 19 08:15:47.263566 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 19 08:15:47.308229 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: Python main interpreter initialized at 0x557be62549c0 Oct 19 08:15:47.308229 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: python threads support enabled Oct 19 08:15:47.308229 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: your server socket listen backlog is limited to 100 connections Oct 19 08:15:47.308229 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: your mercy for graceful operations on workers is 90 seconds Oct 19 08:15:47.308602 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: mapped 403077 bytes (393 KB) for 2 cores Oct 19 08:15:47.308680 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: *** Operational MODE: preforking *** Oct 19 08:15:47.308915 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: *** uWSGI is running in multiple interpreter mode *** Oct 19 08:15:47.308915 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: spawned uWSGI master process (pid: 99119) Oct 19 08:15:47.309129 dv-cinder-813984-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 19 08:15:47.309717 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: spawned uWSGI worker 1 (pid: 99120, cores: 1) Oct 19 08:15:47.311906 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: spawned uWSGI worker 2 (pid: 99121, cores: 1) Oct 19 08:15:47.311906 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 19 08:15:48.947898 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 08:15:48.947898 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: from cryptography.utils import int_from_bytes Oct 19 08:15:48.948567 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 08:15:48.948567 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: from cryptography.utils import int_from_bytes Oct 19 08:15:48.949024 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 08:15:48.949024 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: from cryptography.utils import int_from_bytes Oct 19 08:15:48.949207 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 08:15:48.949207 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: from cryptography.utils import int_from_bytes Oct 19 08:15:51.566042 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 08:15:51.566642 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 08:15:51.566760 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 08:15:51.566760 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 08:15:51.567195 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 08:15:51.567285 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 08:15:51.567371 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 08:15:51.567371 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 08:15:51.567528 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 08:15:51.567657 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 08:15:51.567755 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.568044 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.568157 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.568368 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.568482 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.568688 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.568780 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.569009 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.569102 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.569324 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.569422 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.569643 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.569737 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.569959 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.570049 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.570277 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.570368 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.570572 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.570671 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.570889 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.570992 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.571205 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.571290 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813984-3-iscsi {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.571522 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.571614 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813984-3-iscsi {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.571839 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.571939 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.572139 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.572235 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.572452 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.572543 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.572754 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.572893 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.573068 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.573158 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.573370 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.573454 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.573688 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.573874 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.574199 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.574528 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.574625 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.574835 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.574940 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.575147 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.575260 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.575485 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.575609 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.575812 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.575917 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.576632 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.576722 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.576975 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.577082 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.577282 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.577376 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.577608 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.577698 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.577920 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.578023 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.578316 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813984-3-iscsi {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.578426 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813984-3-iscsi {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.578672 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.578771 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.578990 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.579092 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.579304 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.579397 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.579717 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.579810 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.580029 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.580132 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.580342 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.580447 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.580658 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.580754 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.580982 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.581080 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.581292 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.581379 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.581620 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.581726 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.581939 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.582034 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.582258 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.582352 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.582606 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.582712 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.582912 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.583084 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.583222 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.583309 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.583530 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.583622 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.583847 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.583948 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.584151 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.584259 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.584456 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.584556 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.584704 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.584804 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.585011 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.585105 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.585331 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.585424 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.585652 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.585744 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.585973 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.586069 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.586223 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.586337 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.586474 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.586621 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.586818 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.586915 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.587139 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.587235 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.587448 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.587540 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.587754 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.587848 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.588061 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.588155 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.588368 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.588456 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.588676 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.588771 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.588983 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.589078 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.589291 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.589379 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.589598 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.589691 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.589921 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.590019 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.590232 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.590319 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.590579 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.590670 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.590891 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.590986 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.591209 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.591297 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.591705 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.592414 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.592541 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.592637 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.592899 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.593048 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.593244 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.593395 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.593568 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.593717 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.593881 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.594031 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.594199 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.594356 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.594545 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.594705 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.594863 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.595018 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.595175 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.595328 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.595488 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.595639 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.595814 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.595962 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.596156 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.596296 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.596465 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.596606 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.596719 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.596858 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.597022 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.597159 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.597331 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.597466 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.597653 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.597786 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.597964 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.598132 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.598303 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.598392 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.598642 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.598733 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.598953 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.599052 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.599263 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.599358 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.599574 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.599668 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.599884 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.599990 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.600195 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.600284 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.600501 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.600595 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.600804 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.600898 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.601110 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.601206 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.601415 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.601503 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.601719 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.601806 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.602036 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.602129 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.602354 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.602524 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.602685 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.602773 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.602993 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.603090 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.603299 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.603398 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.603605 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.603694 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.603923 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.604018 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.604228 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.604322 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.604531 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.604624 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.604853 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.604951 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.605159 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.605255 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.605461 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.605565 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.605777 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.605871 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.606081 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.606175 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.606386 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.606472 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.606726 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.606813 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.607026 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.607122 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.607361 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.607454 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.607692 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.607816 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.608086 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.608183 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.608399 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.608486 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.608707 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.608795 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.609009 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.609107 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.609313 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.609401 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.609618 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.609713 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.609923 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.610011 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.610225 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.610315 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.610544 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.610645 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.610867 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.610957 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.611191 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.611286 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.611502 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.611596 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.611809 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.611902 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.612115 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.612202 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.612434 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.612558 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:15:51.612766 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.612856 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.613095 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.613181 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.613437 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.613538 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.613750 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.613843 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.614081 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.614170 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.614412 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.614520 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.614757 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.614919 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.615073 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.615171 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.615388 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.615485 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.615714 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.615800 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.616028 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.616113 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.616341 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.616434 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.616654 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.616739 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.616972 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.617065 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.617572 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.617666 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.617903 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.618014 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.618221 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.618309 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.618555 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.618657 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.618881 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.618976 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.619197 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.619299 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.619516 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.619604 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.619844 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.619931 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.620169 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.620254 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.620481 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.620575 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.620820 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.620916 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.621163 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.621262 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.621476 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.621563 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.621800 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.621887 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.622112 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.622197 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.622437 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.622572 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.622773 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.622936 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.623117 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.623282 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.623430 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.623520 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.623760 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.623855 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.624075 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.624172 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.624391 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.624479 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.624727 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.624821 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.625042 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.625143 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.625357 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.625445 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.625665 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.625753 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.625972 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.626067 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.626276 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.626362 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.626612 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.626715 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.626920 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.627020 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.627243 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.627330 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.627567 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.627668 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.627875 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.627964 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.628206 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.628299 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.628511 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.628604 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.628826 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.628914 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.629139 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.629232 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.629443 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.629530 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.629756 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.629854 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.630070 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.630163 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.630376 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.630472 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.630725 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.630821 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.631037 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.631123 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.631341 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.631427 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.631664 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.631758 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.631971 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.632057 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.632275 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.632369 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.632590 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.632676 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.632901 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.632991 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.633212 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.633307 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.633525 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.633612 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.633845 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.633939 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.634158 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.634345 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.634469 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.634623 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.634827 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.634914 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.635159 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.635259 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.635463 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.635549 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.635789 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.635874 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.636112 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.636207 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.636427 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.636513 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.636733 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.636827 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.637045 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.637139 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.637348 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.637434 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.637652 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.637737 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.637953 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.638047 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.638264 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.638361 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.639100 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.639272 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.639432 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.639520 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.639735 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.639830 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.640048 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.640142 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.640355 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.640450 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.640677 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.640847 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.640987 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.641211 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.641340 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.641525 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.641852 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.641955 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.642040 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.642119 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.642286 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.642468 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.642634 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.642804 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.642943 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.643153 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.643252 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.643493 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.643587 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.643818 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.643904 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.644144 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.644233 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.644490 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.644574 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.644803 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.644898 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.645115 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.645229 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.645426 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.645687 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.645782 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.646047 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.646155 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.646361 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.646456 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.646706 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.646796 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.647021 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.647110 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.647345 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.647432 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.647657 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.647745 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.647979 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.648076 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.648283 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.648370 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.648600 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.648687 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.648941 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.649029 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.649271 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.649371 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.649590 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.649683 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.649917 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.650006 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.650229 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.650323 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.650573 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.650676 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.650890 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.650976 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.651199 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.651285 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.651511 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.651610 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.651822 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.651910 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.652134 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.652221 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.652446 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.652542 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.652766 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.652861 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.653082 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.653201 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.653449 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.653561 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.653709 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.653810 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.654028 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.654206 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.654903 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.655033 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.655285 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.655469 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.655551 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.655661 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.655873 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.655969 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.656186 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.656304 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.656500 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.656641 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.656826 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.656958 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.657138 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.657276 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.657449 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.657602 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.657763 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.657916 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.658070 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.658232 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.658376 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.658573 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.658711 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.658884 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.659028 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.659201 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.659339 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.659516 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.659650 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.659835 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.659961 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.660150 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.660276 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.660464 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.660584 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.660774 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.660888 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.661092 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.661181 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.661404 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.661499 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.661713 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.661801 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.662020 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.662117 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.662337 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.662425 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.662691 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.662779 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.663010 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.663096 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.663315 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.663422 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.663635 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.663723 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.663941 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.664035 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.664243 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.664331 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.664548 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.664636 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.664853 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.665016 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.665160 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.665247 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.665469 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.665564 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.665777 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.665877 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.666091 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.666189 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.666412 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.666526 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.666744 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.666843 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.667058 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.667144 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.667370 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.667457 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.667680 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.667769 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.667995 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.668081 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.668308 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.668395 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.668620 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.668709 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.668932 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.669020 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.669246 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.669333 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.669558 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.669687 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.669899 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.670148 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.670222 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.670314 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.670542 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.670647 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.670848 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.670934 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.671161 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.671248 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.671466 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.671554 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.671776 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.671864 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.672089 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.672184 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.672399 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.672658 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.672753 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.672992 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.673087 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.673325 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.673575 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.673667 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.673915 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.674004 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.674231 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.674330 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.674583 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.674685 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.674910 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.675034 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.675222 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.675319 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.675527 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.675614 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.675835 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.675921 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.676139 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.676227 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.676442 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.676529 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.676754 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.676848 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.677060 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.677148 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.677361 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.677447 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.677665 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.677759 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.677973 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.678103 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.678274 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.678361 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.678605 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.678694 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.678921 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.679017 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.679227 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.679324 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.679530 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.679624 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.679839 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.679937 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.680154 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.680278 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.680459 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.680555 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.680763 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.680849 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.681078 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.681174 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.681381 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.681467 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.681683 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.681770 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.681987 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.682075 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.682294 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.682381 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.682626 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.682727 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.682936 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.683033 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.683280 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.683404 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.683590 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.683689 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.683911 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.684004 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.684217 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.684304 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.684543 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.684643 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.684848 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.684942 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.685153 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.685240 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.685502 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.685606 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.685809 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.685901 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.686117 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.686210 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.686426 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.686553 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.686780 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.686868 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.687095 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.687182 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.687403 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.687501 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.687713 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.687800 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.688019 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.688106 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.688330 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.688422 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.688635 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.688723 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.688936 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.689024 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.689245 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.689335 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.689548 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.689635 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.689856 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.689942 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.690164 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.690252 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.690469 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.690602 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.690796 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.690894 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.691107 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.691195 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.691409 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.691495 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.691714 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.691853 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.692017 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.692103 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.692319 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.692405 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.692621 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.692719 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.692931 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.693019 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.693234 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.693319 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.693533 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.693629 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.693845 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.693932 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.694153 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.694248 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.694456 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.694588 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.694789 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.694876 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.695094 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.695181 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.695399 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.695499 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.695709 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.695797 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.696015 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.696101 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.696319 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.696411 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.696622 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.696709 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.696933 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.697028 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.697237 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.697325 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.697540 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.697633 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.697841 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.697929 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.698146 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.698235 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.698447 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.698583 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.698775 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.698862 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.699078 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.699167 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.699380 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.699474 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.699682 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.699768 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.699986 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.700075 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.700292 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.700379 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.700596 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.700694 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.700900 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.701529 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.701734 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.701862 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.702043 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.702144 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.702352 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.702440 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.702688 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.702777 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.703024 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.703119 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.703329 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.703416 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.703648 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.703741 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.703961 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.704058 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.704275 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.704370 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.704589 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.704678 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.704893 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.704989 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.705207 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.705294 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.705518 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.705604 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.705822 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.705918 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.706122 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.706215 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.706426 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.706562 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.706769 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.706864 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.707075 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.707164 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.707383 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.707470 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.707701 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.707788 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.708012 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.708105 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.708326 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.708452 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.708630 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.708717 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.708942 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.709037 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.709254 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.709341 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.709566 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.709655 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.709877 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.709963 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.710190 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.710291 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.710515 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.710659 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.710826 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.710921 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.711136 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.711231 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.711447 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.711533 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.711760 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.711846 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.712067 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.712163 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.712379 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.712466 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.712691 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.712785 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.712996 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.713092 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.713305 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.713392 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.713619 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.713750 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.713924 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.714012 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.714233 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.714326 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.714561 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.714663 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.714871 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.715021 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.715173 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.715266 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.715480 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.715598 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.715796 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.715914 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.716102 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.716231 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.716532 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.716711 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.717395 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.717508 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.717719 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.717810 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.718004 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.718102 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.718318 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.718405 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.718661 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.718759 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.718976 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.719146 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.719294 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.719388 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.719606 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.719693 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.719978 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.720073 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.720293 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.720399 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.720614 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.720700 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.720908 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.721013 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.721213 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.721305 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.721517 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.721603 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.721820 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.721914 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.722127 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.722213 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.722434 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.722550 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.722766 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.722852 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.723070 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.723155 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.723393 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.723479 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.723700 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.723828 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.724021 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.724116 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.724435 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.724521 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.724748 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.724836 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.725055 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.725141 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.725381 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.725466 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.725708 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.725809 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.726038 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.726132 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.726347 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.726446 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.726690 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.726789 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.727177 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.727260 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.727352 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.727440 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.727614 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.727708 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.727927 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.728012 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.728248 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.728350 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.728553 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.728661 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.728870 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.728966 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.729187 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.729282 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.729497 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.729590 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.729818 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.729902 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.730139 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.730232 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.730459 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.730601 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.730805 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.730893 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.731178 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.731263 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.731505 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.731604 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.731812 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.731899 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.732120 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.732205 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.732476 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.732563 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.732787 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.732983 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.733095 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.733297 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.733396 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.733626 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.733720 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.733932 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.734017 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.734250 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.734358 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.734584 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.734692 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.734900 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.734987 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.735205 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.735300 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.735511 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.735597 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.735814 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.735907 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.736124 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.736219 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.736443 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.736529 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.736747 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.736840 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.737067 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.737154 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.737381 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.737466 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.737683 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.737775 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.738005 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.738093 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.738311 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.738395 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.738638 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.738725 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.738948 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.739047 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.739251 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.739337 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.739561 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.739645 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.739869 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.739956 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.740197 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.740290 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.740508 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.740642 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.740844 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.740952 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.741139 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.741237 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.741474 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.741573 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.741783 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.741870 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.742101 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.742448 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.742714 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.742828 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.743038 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.743126 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.743342 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.743429 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.743645 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.743742 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.743957 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.744054 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.744262 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.744357 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.744564 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.744659 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.744868 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.744955 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.745174 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.745260 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.745474 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.745562 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.745778 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.745866 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.746082 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.746177 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.746403 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.746520 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.746730 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.746826 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.747053 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.747149 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.747365 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.747454 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.747671 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.747766 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.748519 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.748613 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.748828 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.748917 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.749172 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.749280 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.749476 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.749574 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.749810 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.749899 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.750125 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.750211 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.750446 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.750566 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.750804 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.750903 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.751119 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.751224 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.751445 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.751546 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.751761 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.751856 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.752076 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.752163 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.752394 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.752498 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.752711 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.752846 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.753030 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.753118 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.753346 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.753433 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.753663 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.753758 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.753975 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.754065 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.754292 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.754381 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.754632 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.754722 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.754953 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.755052 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.755271 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.755476 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.755594 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.755805 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.756120 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.756209 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.756431 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.756520 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.756748 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.756835 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.757066 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.757161 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.757381 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.757471 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.757693 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.757780 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.758007 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.758104 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.758320 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.758409 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.758660 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.758748 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.758979 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.759080 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.759299 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.759406 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.759620 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.759708 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.759948 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.760038 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.760268 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.760362 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.760585 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.760673 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.760901 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.760994 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.761218 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.761314 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.761538 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.761626 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.761856 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.761953 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.762171 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.762266 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.762498 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.762605 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.762824 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.762919 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.763138 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.763226 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.763454 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.764124 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.764355 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.764460 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.764677 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.764812 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.764992 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.765132 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.765306 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.765453 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.765618 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.765771 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.765934 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.766088 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.766250 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.766403 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.766600 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.766746 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.766937 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.767063 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.767261 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.767392 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.767576 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.767743 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.767890 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.768042 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.768209 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.768360 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.768679 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.768833 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.769000 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.769088 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.769357 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.769526 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.769682 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.769852 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.770015 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.770187 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.770330 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.770546 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.770680 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.771011 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.771107 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.771319 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.771408 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.771628 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.771724 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.771943 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.772040 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.772255 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.772344 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.772562 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.772662 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.772877 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.772964 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.773190 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.773276 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.773498 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.773594 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.773818 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.773904 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.774129 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.774224 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.774435 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.774702 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.774793 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.775051 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.775139 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.775370 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.775608 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.775769 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.775957 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.776039 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.776279 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.776418 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.776609 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.776746 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.776933 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.777069 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.777239 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.777375 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.777548 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.777697 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.777863 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.778010 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.778169 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.778305 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.778471 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.778655 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.778820 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.778956 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.779144 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.779347 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.779574 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.779675 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.779889 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.779977 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.780204 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.780306 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.780511 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.780606 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.780818 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.780907 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.781135 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.781241 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.781441 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.781535 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.781750 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.781837 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.782064 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.782161 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.782371 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.782459 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.782704 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.782793 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.783014 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.783114 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.783319 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.783408 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.783625 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.783711 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.783930 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.784026 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.784234 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.784320 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.784537 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.784623 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.784842 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.784930 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.785215 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.785315 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.785536 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.785624 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.785841 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.785930 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.786165 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.786253 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.786471 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.786593 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.786796 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.786886 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.787113 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.787201 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.787427 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.787514 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.787743 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.787831 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.788054 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.788142 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.788367 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.788463 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.788693 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.788783 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.789011 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.789108 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.789325 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.789541 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.789690 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.789877 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.789988 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.790248 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.790543 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.790653 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.790884 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.790973 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.791249 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.791353 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.791557 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.791655 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.791864 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.791959 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.792189 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.792277 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.792501 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.792602 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.792809 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.792898 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.793119 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.793212 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.793431 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.793521 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.793744 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.793830 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.794054 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.794140 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.794382 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.794551 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.794703 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.794826 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.795048 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.795138 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.795392 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.795527 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.795712 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.795849 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.796032 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.796167 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.796351 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.796513 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.796669 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.796838 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.796981 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.797162 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.797294 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.797483 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.797605 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.797806 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.797901 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.798121 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.798210 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.798435 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.798863 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.799006 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.799124 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.799231 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.799315 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.799395 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.799551 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.799697 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.799867 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.800015 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.800191 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.800325 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.800514 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.800742 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.800844 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.801061 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.801149 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.801385 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.801476 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.801711 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.801809 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.802026 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.802115 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.802350 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.802437 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.802698 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.802788 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.803014 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.803102 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.803341 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.803436 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.803658 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.803748 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.803963 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.804050 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.804270 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.804357 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.804578 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.804668 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.804889 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.804977 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.805222 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.805386 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.805533 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.805628 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.805842 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.805930 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.806152 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.806252 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.806473 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.806581 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.806804 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.806893 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.807126 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.807223 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.807439 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.807532 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.807750 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.807837 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.808063 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.808160 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.808386 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.808473 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.808695 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.808783 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.809008 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.809098 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.809320 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.809408 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.809628 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.809715 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.809944 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.810033 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.810255 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.810921 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.811130 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.811225 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.811464 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.811595 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.811767 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.811855 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.812092 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.812188 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.812411 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.812507 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.812730 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.812820 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.813048 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.813146 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.813361 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.813450 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.813681 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.813768 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.813991 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.814091 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.814308 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.814398 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.814642 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.814734 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.814958 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.815060 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.815276 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.815372 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.815595 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.815685 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.815923 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.816019 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.816249 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.816350 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.816575 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.816663 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.816893 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.816981 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.817230 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.817326 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.817543 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.817637 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.817870 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.817957 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.818202 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.818290 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.818445 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=99121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 08:15:51.818578 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.818898 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.819246 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.819580 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:15:51.819826 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 08:15:51.841326 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG oslo_db.sqlalchemy.engines [None req-6779cbc2-285c-4e52-bc8c-6f3fc17c7337 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99121) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 08:15:51.843256 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG oslo_db.sqlalchemy.engines [None req-4ef6b6e8-479c-44e2-86df-aedaa0bf975f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 08:15:52.016827 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.context [None req-6779cbc2-285c-4e52-bc8c-6f3fc17c7337 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6604bbba-8828-47eb-a883-0d318e12f828(cell1) {{(pid=99121) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 08:15:52.017349 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.context [None req-4ef6b6e8-479c-44e2-86df-aedaa0bf975f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6604bbba-8828-47eb-a883-0d318e12f828(cell1) {{(pid=99120) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 08:15:52.021223 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG oslo_concurrency.lockutils [None req-6779cbc2-285c-4e52-bc8c-6f3fc17c7337 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:15:52.021734 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG oslo_concurrency.lockutils [None req-4ef6b6e8-479c-44e2-86df-aedaa0bf975f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:15:52.022819 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG oslo_concurrency.lockutils [None req-6779cbc2-285c-4e52-bc8c-6f3fc17c7337 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:15:52.023348 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG oslo_concurrency.lockutils [None req-4ef6b6e8-479c-44e2-86df-aedaa0bf975f None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:15:52.023618 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG oslo_concurrency.lockutils [None req-6779cbc2-285c-4e52-bc8c-6f3fc17c7337 None None] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:15:52.024143 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG oslo_concurrency.lockutils [None req-4ef6b6e8-479c-44e2-86df-aedaa0bf975f None None] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:15:52.025543 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG oslo_concurrency.lockutils [None req-6779cbc2-285c-4e52-bc8c-6f3fc17c7337 None None] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:15:52.026059 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG oslo_concurrency.lockutils [None req-4ef6b6e8-479c-44e2-86df-aedaa0bf975f None None] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:15:52.036818 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG oslo_db.sqlalchemy.engines [None req-6779cbc2-285c-4e52-bc8c-6f3fc17c7337 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99121) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 08:15:52.039583 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG oslo_db.sqlalchemy.engines [None req-4ef6b6e8-479c-44e2-86df-aedaa0bf975f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 08:15:52.041967 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG oslo_db.sqlalchemy.engines [None req-6779cbc2-285c-4e52-bc8c-6f3fc17c7337 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99121) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 08:15:52.044683 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG oslo_db.sqlalchemy.engines [None req-4ef6b6e8-479c-44e2-86df-aedaa0bf975f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 08:15:52.304687 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG oslo_db.sqlalchemy.engines [None req-6779cbc2-285c-4e52-bc8c-6f3fc17c7337 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99121) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 08:15:52.311311 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG oslo_db.sqlalchemy.engines [None req-4ef6b6e8-479c-44e2-86df-aedaa0bf975f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 08:15:52.647543 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: WARNING keystonemiddleware.auth_token [None req-6779cbc2-285c-4e52-bc8c-6f3fc17c7337 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 08:15:52.651046 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: WARNING keystonemiddleware.auth_token [None req-4ef6b6e8-479c-44e2-86df-aedaa0bf975f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 08:15:52.653989 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: WARNING keystonemiddleware.auth_token [None req-6779cbc2-285c-4e52-bc8c-6f3fc17c7337 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 08:15:52.658747 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: WARNING keystonemiddleware.auth_token [None req-4ef6b6e8-479c-44e2-86df-aedaa0bf975f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 08:15:53.002451 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: WARNING keystonemiddleware.auth_token [None req-6779cbc2-285c-4e52-bc8c-6f3fc17c7337 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 08:15:53.007497 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: WARNING keystonemiddleware.auth_token [None req-6779cbc2-285c-4e52-bc8c-6f3fc17c7337 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 08:15:53.009403 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: WARNING keystonemiddleware.auth_token [None req-4ef6b6e8-479c-44e2-86df-aedaa0bf975f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 08:15:53.014091 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557be62549c0 pid: 99121 (default app) Oct 19 08:15:53.015471 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: WARNING keystonemiddleware.auth_token [None req-4ef6b6e8-479c-44e2-86df-aedaa0bf975f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 08:15:53.016331 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-6779cbc2-285c-4e52-bc8c-6f3fc17c7337 None None] Calling method '>' {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:15:53.017492 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-6779cbc2-285c-4e52-bc8c-6f3fc17c7337 None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001718 Oct 19 08:15:53.017899 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Tue Oct 19 08:15:53 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:15:53.021597 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557be62549c0 pid: 99120 (default app) Oct 19 08:17:14.753613 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-6779cbc2-285c-4e52-bc8c-6f3fc17c7337 None None] Calling method '>' {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:17:14.755020 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-6779cbc2-285c-4e52-bc8c-6f3fc17c7337 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002063 Oct 19 08:17:14.755780 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 930 bytes} [Tue Oct 19 08:17:14 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:17:15.199630 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-65647eac-0979-487b-9043-14c60659f42e admin admin] Calling method '>' {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:17:15.229716 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-65647eac-0979-487b-9043-14c60659f42e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.466684 Oct 19 08:17:15.230792 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1291 bytes} [Tue Oct 19 08:17:14 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:17:17.562882 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-6779cbc2-285c-4e52-bc8c-6f3fc17c7337 None None] Calling method '>' {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:17:17.564155 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-6779cbc2-285c-4e52-bc8c-6f3fc17c7337 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Oct 19 08:17:17.564711 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 3/4] 10.222.0.26 () {54 vars in 930 bytes} [Tue Oct 19 08:17:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:17:17.625179 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-69d66367-fe14-4773-b917-007a27eef919 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "c1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "vcpus": 1, "ram": 256, "swap": 0}} {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:17:17.643241 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:17:17.643241 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: warnings.warn(msg) Oct 19 08:17:17.674366 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-69d66367-fe14-4773-b917-007a27eef919 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.103027 Oct 19 08:17:17.675495 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 2/5] 10.222.0.26 () {64 vars in 1282 bytes} [Tue Oct 19 08:17:17 2021] POST /compute/v2.1/flavors => generated 407 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:17:17.922424 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-08e0ea2d-e353-4e64-a85e-38677df8e2fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:17:17.924966 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:17:17.924966 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: warnings.warn(msg) Oct 19 08:17:17.978367 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-08e0ea2d-e353-4e64-a85e-38677df8e2fc admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.293733 Oct 19 08:17:17.979291 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 4/6] 10.222.0.26 () {64 vars in 1335 bytes} [Tue Oct 19 08:17:17 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:17:20.295318 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-69d66367-fe14-4773-b917-007a27eef919 admin admin] Calling method '>' {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:17:20.296300 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-69d66367-fe14-4773-b917-007a27eef919 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001625 Oct 19 08:17:20.296841 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 3/7] 10.222.0.26 () {54 vars in 930 bytes} [Tue Oct 19 08:17:20 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:17:20.414250 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-727ceb76-5e9d-4fd1-8d6b-d1a037e98b23 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d1", "name": "ds512M", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:17:20.435001 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:17:20.435001 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: warnings.warn(msg) Oct 19 08:17:20.456179 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-727ceb76-5e9d-4fd1-8d6b-d1a037e98b23 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.152569 Oct 19 08:17:20.456923 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 5/8] 10.222.0.26 () {64 vars in 1282 bytes} [Tue Oct 19 08:17:20 2021] POST /compute/v2.1/flavors => generated 404 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:17:20.470085 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-22552929-d21b-4c54-84f5-401816fb1bb2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:17:20.472144 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:17:20.472144 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: warnings.warn(msg) Oct 19 08:17:20.510583 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-22552929-d21b-4c54-84f5-401816fb1bb2 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045090 Oct 19 08:17:20.511329 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 4/9] 10.222.0.26 () {64 vars in 1335 bytes} [Tue Oct 19 08:17:20 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:17:22.873523 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-727ceb76-5e9d-4fd1-8d6b-d1a037e98b23 admin admin] Calling method '>' {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:17:22.875016 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-727ceb76-5e9d-4fd1-8d6b-d1a037e98b23 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002404 Oct 19 08:17:22.875412 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 930 bytes} [Tue Oct 19 08:17:22 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:17:22.936002 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-404265a5-9fe1-4799-af00-d0ac11e5562c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 1024, "disk": 10, "name": "ds1G", "swap": 0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:17:22.959456 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-404265a5-9fe1-4799-af00-d0ac11e5562c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076991 Oct 19 08:17:22.962519 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 5/11] 10.222.0.26 () {64 vars in 1282 bytes} [Tue Oct 19 08:17:22 2021] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:17:22.972394 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-0ad092cf-1155-4e94-b88f-a6b79bd94caa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:17:22.996590 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-0ad092cf-1155-4e94-b88f-a6b79bd94caa admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027889 Oct 19 08:17:22.997496 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 7/12] 10.222.0.26 () {64 vars in 1335 bytes} [Tue Oct 19 08:17:22 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:17:25.339413 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-404265a5-9fe1-4799-af00-d0ac11e5562c admin admin] Calling method '>' {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:17:25.340491 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-404265a5-9fe1-4799-af00-d0ac11e5562c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001615 Oct 19 08:17:25.340951 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 6/13] 10.222.0.26 () {54 vars in 930 bytes} [Tue Oct 19 08:17:25 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:17:25.399914 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-18dddc08-344a-4b9c-a0e2-3ad2e855416a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds2G", "vcpus": 2, "disk": 10, "os-flavor-access:is_public": true}} {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:17:25.419526 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-18dddc08-344a-4b9c-a0e2-3ad2e855416a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071579 Oct 19 08:17:25.420123 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 8/14] 10.222.0.26 () {64 vars in 1282 bytes} [Tue Oct 19 08:17:25 2021] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:17:25.432452 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-ed9af697-4cde-4d15-a8a0-5868af11985d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:17:25.454707 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-ed9af697-4cde-4d15-a8a0-5868af11985d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025919 Oct 19 08:17:25.455271 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 7/15] 10.222.0.26 () {64 vars in 1335 bytes} [Tue Oct 19 08:17:25 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:17:27.781574 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-18dddc08-344a-4b9c-a0e2-3ad2e855416a admin admin] Calling method '>' {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:17:27.782602 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-18dddc08-344a-4b9c-a0e2-3ad2e855416a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Oct 19 08:17:27.782999 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 9/16] 10.222.0.26 () {54 vars in 930 bytes} [Tue Oct 19 08:17:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:17:27.845344 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-c0e49112-ca45-41e0-b461-c8810bf5707d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "ram": 4096, "name": "ds4G", "os-flavor-access:is_public": true, "vcpus": 4, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:17:27.863433 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-c0e49112-ca45-41e0-b461-c8810bf5707d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074019 Oct 19 08:17:27.864324 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 8/17] 10.222.0.26 () {64 vars in 1282 bytes} [Tue Oct 19 08:17:27 2021] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:17:27.877396 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-5178aeb9-5de4-4187-9061-569336be0d63 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:17:27.900637 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-5178aeb9-5de4-4187-9061-569336be0d63 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027483 Oct 19 08:17:27.901653 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 10/18] 10.222.0.26 () {64 vars in 1335 bytes} [Tue Oct 19 08:17:27 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:17:30.255831 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-c0e49112-ca45-41e0-b461-c8810bf5707d admin admin] Calling method '>' {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:17:30.256893 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-c0e49112-ca45-41e0-b461-c8810bf5707d admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Oct 19 08:17:30.257341 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 9/19] 10.222.0.26 () {54 vars in 930 bytes} [Tue Oct 19 08:17:30 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:17:30.322929 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-c10c86bd-4bf9-4981-bbb4-aeda821161c5 admin admin] Calling method '>' {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:17:30.346602 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-c10c86bd-4bf9-4981-bbb4-aeda821161c5 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081247 Oct 19 08:17:30.347091 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1291 bytes} [Tue Oct 19 08:17:30 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:17:32.650054 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-c0e49112-ca45-41e0-b461-c8810bf5707d admin admin] Calling method '>' {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:17:32.651134 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-c0e49112-ca45-41e0-b461-c8810bf5707d admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Oct 19 08:17:32.651538 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 10/21] 10.222.0.26 () {54 vars in 930 bytes} [Tue Oct 19 08:17:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:17:32.710467 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-9bc613a6-6ad8-477c-8a94-8c257555391b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "ram": 512, "swap": 0, "disk": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:17:32.728384 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-9bc613a6-6ad8-477c-8a94-8c257555391b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.070398 Oct 19 08:17:32.728908 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 12/22] 10.222.0.26 () {64 vars in 1282 bytes} [Tue Oct 19 08:17:32 2021] POST /compute/v2.1/flavors => generated 402 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:17:32.745758 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-8f11f03b-60b2-4cb8-b0f7-cd787c0951b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:17:32.771045 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-8f11f03b-60b2-4cb8-b0f7-cd787c0951b2 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030106 Oct 19 08:17:32.771629 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 11/23] 10.222.0.26 () {64 vars in 1332 bytes} [Tue Oct 19 08:17:32 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:17:35.547009 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-9bc613a6-6ad8-477c-8a94-8c257555391b admin admin] Calling method '>' {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:17:35.548105 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-9bc613a6-6ad8-477c-8a94-8c257555391b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 Oct 19 08:17:35.548517 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 930 bytes} [Tue Oct 19 08:17:35 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:17:35.617473 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-33869293-7a67-4995-8686-41cb2edfadf6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.small", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "2", "ram": 2048}} {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:17:35.635364 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-33869293-7a67-4995-8686-41cb2edfadf6 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.080278 Oct 19 08:17:35.635914 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 12/25] 10.222.0.26 () {64 vars in 1282 bytes} [Tue Oct 19 08:17:35 2021] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:17:35.648566 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-7655199e-dad4-44cb-949b-fed9e768183d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:17:35.672254 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-7655199e-dad4-44cb-949b-fed9e768183d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027058 Oct 19 08:17:35.672926 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 14/26] 10.222.0.26 () {64 vars in 1332 bytes} [Tue Oct 19 08:17:35 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:17:37.968872 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-33869293-7a67-4995-8686-41cb2edfadf6 admin admin] Calling method '>' {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:17:37.969822 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-33869293-7a67-4995-8686-41cb2edfadf6 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001396 Oct 19 08:17:37.970217 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 930 bytes} [Tue Oct 19 08:17:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 08:17:38.028150 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-7304c0da-cc27-4206-8820-77de64dc9449 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "ram": 4096, "name": "m1.medium", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:17:38.045708 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-7304c0da-cc27-4206-8820-77de64dc9449 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.069018 Oct 19 08:17:38.046437 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 15/28] 10.222.0.26 () {64 vars in 1282 bytes} [Tue Oct 19 08:17:37 2021] POST /compute/v2.1/flavors => generated 406 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:17:38.058448 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-7353f25a-dad5-4b90-805f-e61ab4e041f4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:17:38.081846 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-7353f25a-dad5-4b90-805f-e61ab4e041f4 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026909 Oct 19 08:17:38.082665 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 14/29] 10.222.0.26 () {64 vars in 1332 bytes} [Tue Oct 19 08:17:38 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:17:40.417192 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-7304c0da-cc27-4206-8820-77de64dc9449 admin admin] Calling method '>' {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:17:40.418206 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-7304c0da-cc27-4206-8820-77de64dc9449 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 19 08:17:40.418652 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 930 bytes} [Tue Oct 19 08:17:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:17:40.483912 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-e0ce29e7-dacb-4889-a948-63604c9f490e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "id": "4", "swap": 0, "rxtx_factor": 1.0}} {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:17:40.503341 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-e0ce29e7-dacb-4889-a948-63604c9f490e admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077288 Oct 19 08:17:40.504021 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 15/31] 10.222.0.26 () {64 vars in 1282 bytes} [Tue Oct 19 08:17:40 2021] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:17:40.516922 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-31a94e95-63df-422f-964e-7c999a4fc88b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:17:40.545192 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-31a94e95-63df-422f-964e-7c999a4fc88b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032310 Oct 19 08:17:40.545768 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 17/32] 10.222.0.26 () {64 vars in 1332 bytes} [Tue Oct 19 08:17:40 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:17:42.931482 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-e0ce29e7-dacb-4889-a948-63604c9f490e admin admin] Calling method '>' {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:17:42.932482 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-e0ce29e7-dacb-4889-a948-63604c9f490e admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 19 08:17:42.933135 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 16/33] 10.222.0.26 () {54 vars in 930 bytes} [Tue Oct 19 08:17:42 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:17:42.991497 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-487412c9-c7eb-41fd-83b4-00dea44c148e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "id": "5", "rxtx_factor": 1.0, "vcpus": 8, "ram": 16384, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "swap": 0}} {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:17:43.013576 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-487412c9-c7eb-41fd-83b4-00dea44c148e admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.073606 Oct 19 08:17:43.021597 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 18/34] 10.222.0.26 () {64 vars in 1282 bytes} [Tue Oct 19 08:17:42 2021] POST /compute/v2.1/flavors => generated 408 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:17:43.026468 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-262ed95a-c724-4735-931d-03a71ba42466 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:17:43.054407 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-262ed95a-c724-4735-931d-03a71ba42466 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031537 Oct 19 08:17:43.055321 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1332 bytes} [Tue Oct 19 08:17:43 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:18:22.021615 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-487412c9-c7eb-41fd-83b4-00dea44c148e admin admin] Calling method '>' {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:18:22.022677 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-487412c9-c7eb-41fd-83b4-00dea44c148e admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Oct 19 08:18:22.023073 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 930 bytes} [Tue Oct 19 08:18:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:18:22.080657 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-9ffd056f-95fd-4714-8c8f-b86700867977 admin admin] Calling method '>' {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:18:22.097154 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-9ffd056f-95fd-4714-8c8f-b86700867977 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067242 Oct 19 08:18:22.097683 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1291 bytes} [Tue Oct 19 08:18:22 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:18:23.604927 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-487412c9-c7eb-41fd-83b4-00dea44c148e admin admin] Calling method '>' {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:18:23.605914 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-487412c9-c7eb-41fd-83b4-00dea44c148e admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Oct 19 08:18:23.606310 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 19 08:18:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:18:23.796127 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-4e00e1d9-165e-47cc-9e27-31d0cdedeae8 admin admin] Calling method '>' {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:18:23.801482 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.wsgi [None req-4e00e1d9-165e-47cc-9e27-31d0cdedeae8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 19 08:18:23.802042 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-4e00e1d9-165e-47cc-9e27-31d0cdedeae8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=99120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:18:23.802875 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-4e00e1d9-165e-47cc-9e27-31d0cdedeae8 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058125 Oct 19 08:18:23.803382 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1190 bytes} [Tue Oct 19 08:18:23 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 08:18:23.813134 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-09431fc8-01a0-4a2f-a0ca-605bb2b78f90 admin admin] Calling method '>' {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:18:23.833894 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-09431fc8-01a0-4a2f-a0ca-605bb2b78f90 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024431 Oct 19 08:18:23.834434 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1210 bytes} [Tue Oct 19 08:18:23 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:18:23.845073 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-d9b6a426-d973-426d-b68c-836e386d4ed6 admin admin] Calling method '>' {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:18:23.866405 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-d9b6a426-d973-426d-b68c-836e386d4ed6 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025469 Oct 19 08:18:23.866949 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1210 bytes} [Tue Oct 19 08:18:23 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:18:23.876883 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-11db4210-e0ae-4784-a524-92d374dfef07 admin admin] Calling method '>' {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:18:23.882135 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.wsgi [None req-11db4210-e0ae-4784-a524-92d374dfef07 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 19 08:18:23.882741 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-11db4210-e0ae-4784-a524-92d374dfef07 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=99121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:18:23.883526 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-11db4210-e0ae-4784-a524-92d374dfef07 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010156 Oct 19 08:18:23.884012 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1190 bytes} [Tue Oct 19 08:18:23 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 08:18:25.278749 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-d9b6a426-d973-426d-b68c-836e386d4ed6 admin admin] Calling method '>' {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:18:25.279736 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-d9b6a426-d973-426d-b68c-836e386d4ed6 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Oct 19 08:18:25.280127 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 21/43] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 19 08:18:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:18:25.470285 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-c6b1afc5-6f95-4ed3-8305-7e6c7547b998 admin admin] Calling method '>' {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:18:25.475891 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.wsgi [None req-c6b1afc5-6f95-4ed3-8305-7e6c7547b998 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 19 08:18:25.476454 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-c6b1afc5-6f95-4ed3-8305-7e6c7547b998 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=99121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:18:25.477234 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-c6b1afc5-6f95-4ed3-8305-7e6c7547b998 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058458 Oct 19 08:18:25.477719 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1190 bytes} [Tue Oct 19 08:18:25 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 08:18:25.488396 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-16623fe9-9de6-4eed-9204-710ad350a455 admin admin] Calling method '>' {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:18:25.501874 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-16623fe9-9de6-4eed-9204-710ad350a455 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017034 Oct 19 08:18:25.502392 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1210 bytes} [Tue Oct 19 08:18:25 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:18:25.511981 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-93b4f82f-1960-42d2-b193-7f90a23dbe7c admin admin] Calling method '>' {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:18:25.525107 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-93b4f82f-1960-42d2-b193-7f90a23dbe7c admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016571 Oct 19 08:18:25.525626 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1210 bytes} [Tue Oct 19 08:18:25 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:18:25.535859 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-59820ea9-9c23-469b-b464-4504649b1aa2 admin admin] Calling method '>' {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:18:25.540846 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.wsgi [None req-59820ea9-9c23-469b-b464-4504649b1aa2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 19 08:18:25.541390 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-59820ea9-9c23-469b-b464-4504649b1aa2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=99120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:18:25.542154 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-59820ea9-9c23-469b-b464-4504649b1aa2 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009676 Oct 19 08:18:25.542653 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 23/47] 10.222.0.26 () {60 vars in 1190 bytes} [Tue Oct 19 08:18:25 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 19 08:18:26.943210 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-93b4f82f-1960-42d2-b193-7f90a23dbe7c admin admin] Calling method '>' {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:18:26.944201 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-93b4f82f-1960-42d2-b193-7f90a23dbe7c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Oct 19 08:18:26.944596 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 25/48] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 19 08:18:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:18:27.131650 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-c8aea91c-edad-4e9d-963a-d2d355af9f2d admin admin] Calling method '>' {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:18:27.137240 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.wsgi [None req-c8aea91c-edad-4e9d-963a-d2d355af9f2d admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 19 08:18:27.137994 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-c8aea91c-edad-4e9d-963a-d2d355af9f2d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=99120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:18:27.138818 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-c8aea91c-edad-4e9d-963a-d2d355af9f2d admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058030 Oct 19 08:18:27.139316 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 24/49] 10.222.0.26 () {60 vars in 1193 bytes} [Tue Oct 19 08:18:27 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 08:18:27.148912 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-11f3db4a-0d2f-47f7-8699-d32f6159a91c admin admin] Calling method '>' {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:18:27.162570 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-11f3db4a-0d2f-47f7-8699-d32f6159a91c admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017015 Oct 19 08:18:27.163013 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1210 bytes} [Tue Oct 19 08:18:27 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:18:27.173216 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-55f6f158-53ee-4f6a-ab9c-85d4040421f0 admin admin] Calling method '>' {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:18:27.186277 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-55f6f158-53ee-4f6a-ab9c-85d4040421f0 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017103 Oct 19 08:18:27.186824 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1210 bytes} [Tue Oct 19 08:18:27 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:18:27.196275 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-c3cc5a44-d86a-4933-b530-2a8db5084abc admin admin] Calling method '>' {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:18:27.201467 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.wsgi [None req-c3cc5a44-d86a-4933-b530-2a8db5084abc admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 19 08:18:27.202008 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-c3cc5a44-d86a-4933-b530-2a8db5084abc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=99121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:18:27.202816 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-c3cc5a44-d86a-4933-b530-2a8db5084abc admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009936 Oct 19 08:18:27.203292 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 27/52] 10.222.0.26 () {60 vars in 1193 bytes} [Tue Oct 19 08:18:27 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 19 08:18:28.619137 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-55f6f158-53ee-4f6a-ab9c-85d4040421f0 admin admin] Calling method '>' {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:18:28.620169 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-55f6f158-53ee-4f6a-ab9c-85d4040421f0 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Oct 19 08:18:28.620867 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 19 08:18:28 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:18:28.812011 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-1f12a37c-3084-4113-ad83-86d6b56d8f93 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:18:28.829615 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-1f12a37c-3084-4113-ad83-86d6b56d8f93 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068486 Oct 19 08:18:28.830432 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1235 bytes} [Tue Oct 19 08:18:28 2021] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:18:30.229675 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-55f6f158-53ee-4f6a-ab9c-85d4040421f0 admin admin] Calling method '>' {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:18:30.230704 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-55f6f158-53ee-4f6a-ab9c-85d4040421f0 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Oct 19 08:18:30.231102 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 19 08:18:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:18:30.423345 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-ac2ee1c7-3e12-45f4-8894-2a616bcebe61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:18:30.440955 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-ac2ee1c7-3e12-45f4-8894-2a616bcebe61 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069374 Oct 19 08:18:30.441495 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 29/56] 10.222.0.26 () {64 vars in 1235 bytes} [Tue Oct 19 08:18:30 2021] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:18:31.835182 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-55f6f158-53ee-4f6a-ab9c-85d4040421f0 admin admin] Calling method '>' {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:18:31.836184 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-55f6f158-53ee-4f6a-ab9c-85d4040421f0 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Oct 19 08:18:31.836577 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 19 08:18:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:18:32.024532 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-45b18526-dd01-4fcd-92e4-3b7ea0dacb6e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:18:32.044422 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-45b18526-dd01-4fcd-92e4-3b7ea0dacb6e admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070774 Oct 19 08:18:32.044896 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 30/58] 10.222.0.26 () {64 vars in 1235 bytes} [Tue Oct 19 08:18:31 2021] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:18:33.436908 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-55f6f158-53ee-4f6a-ab9c-85d4040421f0 admin admin] Calling method '>' {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:18:33.437903 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-55f6f158-53ee-4f6a-ab9c-85d4040421f0 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Oct 19 08:18:33.438290 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 29/59] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 19 08:18:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:18:33.631997 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-d292e244-0a90-42e2-8ed1-be89a11f66a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:18:33.653208 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-d292e244-0a90-42e2-8ed1-be89a11f66a3 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.072727 Oct 19 08:18:33.654378 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 31/60] 10.222.0.26 () {64 vars in 1235 bytes} [Tue Oct 19 08:18:33 2021] POST /compute/v2.1/flavors => generated 409 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:18:35.068160 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-55f6f158-53ee-4f6a-ab9c-85d4040421f0 admin admin] Calling method '>' {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:18:35.069157 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-55f6f158-53ee-4f6a-ab9c-85d4040421f0 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Oct 19 08:18:35.069553 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 30/61] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 19 08:18:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:18:35.263662 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-e1cb2e9a-cb1b-49c4-adf8-805940f90fd3 admin admin] Calling method '>' {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:18:35.283104 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-e1cb2e9a-cb1b-49c4-adf8-805940f90fd3 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.074186 Oct 19 08:18:35.283578 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 32/62] 10.222.0.26 () {60 vars in 1202 bytes} [Tue Oct 19 08:18:35 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:19:21.599644 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-55f6f158-53ee-4f6a-ab9c-85d4040421f0 admin admin] Calling method '>' {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:19:21.600639 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-55f6f158-53ee-4f6a-ab9c-85d4040421f0 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Oct 19 08:19:21.601030 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 930 bytes} [Tue Oct 19 08:19:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:19:21.659320 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-0a199630-a2fa-45a6-ba78-87cb6504c01d admin admin] Calling method '>' {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:19:21.678473 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-0a199630-a2fa-45a6-ba78-87cb6504c01d admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070259 Oct 19 08:19:21.679024 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 33/64] 10.222.0.26 () {60 vars in 1291 bytes} [Tue Oct 19 08:19:21 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:19:21.702017 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-c99a488a-d192-4ea2-927d-a46de224cc7a admin admin] Calling method '>' {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:19:21.709468 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-c99a488a-d192-4ea2-927d-a46de224cc7a admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011731 Oct 19 08:19:21.709974 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1282 bytes} [Tue Oct 19 08:19:21 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:19:21.722087 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-a6c8ecee-e41d-49c1-9541-c0f0ed76f274 admin admin] Calling method '>' {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:19:21.729786 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-a6c8ecee-e41d-49c1-9541-c0f0ed76f274 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011120 Oct 19 08:19:21.730285 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1285 bytes} [Tue Oct 19 08:19:21 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:19:21.741763 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-cd45a3dc-9359-4718-a0ad-38e663438ea9 admin admin] Calling method '>' {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:19:21.749424 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-cd45a3dc-9359-4718-a0ad-38e663438ea9 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011020 Oct 19 08:19:21.749929 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1285 bytes} [Tue Oct 19 08:19:21 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:19:21.763622 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-be57b095-e13a-4fc0-869b-d64e1e7ba0ea admin admin] Calling method '>' {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:19:21.771573 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-be57b095-e13a-4fc0-869b-d64e1e7ba0ea admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012347 Oct 19 08:19:21.772093 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1282 bytes} [Tue Oct 19 08:19:21 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:20:51.146259 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-9157e615-365d-4472-bdb3-f5f7f468f4af tempest-verify_tempest_config-1492967612 tempest-verify_tempest_config-1492967612-project] Calling method '>' {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:20:51.148243 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-9157e615-365d-4472-bdb3-f5f7f468f4af tempest-verify_tempest_config-1492967612 tempest-verify_tempest_config-1492967612-project] 10.222.0.26 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.104897 Oct 19 08:20:51.148774 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 34/69] 10.222.0.26 () {58 vars in 1133 bytes} [Tue Oct 19 08:20:51 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:22:14.658104 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-be57b095-e13a-4fc0-869b-d64e1e7ba0ea admin admin] Calling method '>' {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:22:14.659060 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-be57b095-e13a-4fc0-869b-d64e1e7ba0ea admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 19 08:22:14.659449 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 36/70] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 19 08:22:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:22:14.915572 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-79d703f2-6094-4a55-9e8a-f9fb3d85da44 admin admin] Calling method '>' {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:22:14.916714 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:22:14.916714 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: warnings.warn(msg) Oct 19 08:22:14.918231 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG oslo_concurrency.lockutils [None req-79d703f2-6094-4a55-9e8a-f9fb3d85da44 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:22:14.918716 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG oslo_concurrency.lockutils [None req-79d703f2-6094-4a55-9e8a-f9fb3d85da44 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:22:14.920023 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG oslo_concurrency.lockutils [None req-79d703f2-6094-4a55-9e8a-f9fb3d85da44 admin admin] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:22:14.920480 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG oslo_concurrency.lockutils [None req-79d703f2-6094-4a55-9e8a-f9fb3d85da44 admin admin] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:22:14.953105 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-79d703f2-6094-4a55-9e8a-f9fb3d85da44 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.147505 Oct 19 08:22:14.953647 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 35/71] 10.222.0.26 () {60 vars in 1193 bytes} [Tue Oct 19 08:22:14 2021] GET /compute/v2.1/os-services => generated 791 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:22:16.386400 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-be57b095-e13a-4fc0-869b-d64e1e7ba0ea admin admin] Calling method '>' {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:22:16.387464 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-be57b095-e13a-4fc0-869b-d64e1e7ba0ea admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Oct 19 08:22:16.387866 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 37/72] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 19 08:22:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:22:16.598241 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-4d5657cb-94d2-4cd4-9ff0-03cdc1cda3da admin admin] Calling method '>' {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:22:16.599413 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:22:16.599413 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: warnings.warn(msg) Oct 19 08:22:16.600949 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG oslo_concurrency.lockutils [None req-4d5657cb-94d2-4cd4-9ff0-03cdc1cda3da admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:22:16.601386 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG oslo_concurrency.lockutils [None req-4d5657cb-94d2-4cd4-9ff0-03cdc1cda3da admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:22:16.602163 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG oslo_concurrency.lockutils [None req-4d5657cb-94d2-4cd4-9ff0-03cdc1cda3da admin admin] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:22:16.602641 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG oslo_concurrency.lockutils [None req-4d5657cb-94d2-4cd4-9ff0-03cdc1cda3da admin admin] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:22:16.621848 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-4d5657cb-94d2-4cd4-9ff0-03cdc1cda3da admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.089772 Oct 19 08:22:16.622419 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 36/73] 10.222.0.26 () {60 vars in 1193 bytes} [Tue Oct 19 08:22:16 2021] GET /compute/v2.1/os-services => generated 791 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:22:28.463118 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-be57b095-e13a-4fc0-869b-d64e1e7ba0ea admin admin] Calling method '>' {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:22:28.464141 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-be57b095-e13a-4fc0-869b-d64e1e7ba0ea admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 19 08:22:28.464533 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 38/74] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 19 08:22:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:22:28.657207 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-ab789517-2a71-4f3e-b0f6-023e965aa1e4 admin admin] Calling method '>' {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:22:28.658381 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:22:28.658381 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: warnings.warn(msg) Oct 19 08:22:28.659909 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG oslo_concurrency.lockutils [None req-ab789517-2a71-4f3e-b0f6-023e965aa1e4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:22:28.660353 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG oslo_concurrency.lockutils [None req-ab789517-2a71-4f3e-b0f6-023e965aa1e4 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:22:28.661165 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG oslo_concurrency.lockutils [None req-ab789517-2a71-4f3e-b0f6-023e965aa1e4 admin admin] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:22:28.661596 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG oslo_concurrency.lockutils [None req-ab789517-2a71-4f3e-b0f6-023e965aa1e4 admin admin] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:22:28.686546 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-ab789517-2a71-4f3e-b0f6-023e965aa1e4 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079896 Oct 19 08:22:28.687089 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 37/75] 10.222.0.26 () {60 vars in 1193 bytes} [Tue Oct 19 08:22:28 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:22:30.100060 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: DEBUG nova.api.openstack.wsgi [None req-be57b095-e13a-4fc0-869b-d64e1e7ba0ea admin admin] Calling method '>' {{(pid=99121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:22:30.101082 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: INFO nova.api.openstack.requestlog [None req-be57b095-e13a-4fc0-869b-d64e1e7ba0ea admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001395 Oct 19 08:22:30.101500 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: [pid: 99121|app: 0|req: 39/76] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 19 08:22:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:22:30.293848 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG nova.api.openstack.wsgi [None req-9b678d9b-96d4-4fb2-be2b-6222024662fc admin admin] Calling method '>' {{(pid=99120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:22:30.295100 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:22:30.295100 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: warnings.warn(msg) Oct 19 08:22:30.296630 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG oslo_concurrency.lockutils [None req-9b678d9b-96d4-4fb2-be2b-6222024662fc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:22:30.297063 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG oslo_concurrency.lockutils [None req-9b678d9b-96d4-4fb2-be2b-6222024662fc admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:22:30.297833 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG oslo_concurrency.lockutils [None req-9b678d9b-96d4-4fb2-be2b-6222024662fc admin admin] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:22:30.298251 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: DEBUG oslo_concurrency.lockutils [None req-9b678d9b-96d4-4fb2-be2b-6222024662fc admin admin] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:22:30.319314 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: INFO nova.api.openstack.requestlog [None req-9b678d9b-96d4-4fb2-be2b-6222024662fc admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077219 Oct 19 08:22:30.319850 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: [pid: 99120|app: 0|req: 38/77] 10.222.0.26 () {60 vars in 1193 bytes} [Tue Oct 19 08:22:30 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:23:26.230915 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: Tue Oct 19 08:23:26 2021 - graceful shutdown triggered... Oct 19 08:23:26.231027 dv-cinder-813984-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 19 08:23:26.231929 dv-cinder-813984-3-iscsi devstack@n-api.service[99121]: Gracefully killing worker 2 (pid: 99121)... Oct 19 08:23:26.232873 dv-cinder-813984-3-iscsi devstack@n-api.service[99120]: Gracefully killing worker 1 (pid: 99120)... Oct 19 08:23:27.232036 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: worker 1 buried after 1 seconds Oct 19 08:23:27.232625 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: worker 2 buried after 1 seconds Oct 19 08:23:27.232625 dv-cinder-813984-3-iscsi devstack@n-api.service[99119]: goodbye to uWSGI. Oct 19 08:23:27.234023 dv-cinder-813984-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 19 08:23:27.234639 dv-cinder-813984-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 19 08:23:27.237484 dv-cinder-813984-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 19 08:23:27.246757 dv-cinder-813984-3-iscsi devstack@n-api.service[114088]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 19 08:23:27.249503 dv-cinder-813984-3-iscsi devstack@n-api.service[114088]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 19 08:23:27 2021] *** Oct 19 08:23:27.249503 dv-cinder-813984-3-iscsi devstack@n-api.service[114088]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 19 08:23:27.249503 dv-cinder-813984-3-iscsi devstack@n-api.service[114088]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 19 08:23:27.249503 dv-cinder-813984-3-iscsi devstack@n-api.service[114088]: nodename: dv-cinder-813984-3-iscsi Oct 19 08:23:27.249503 dv-cinder-813984-3-iscsi devstack@n-api.service[114088]: machine: x86_64 Oct 19 08:23:27.249503 dv-cinder-813984-3-iscsi devstack@n-api.service[114088]: clock source: unix Oct 19 08:23:27.249503 dv-cinder-813984-3-iscsi devstack@n-api.service[114088]: pcre jit disabled Oct 19 08:23:27.249503 dv-cinder-813984-3-iscsi devstack@n-api.service[114088]: detected number of CPU cores: 4 Oct 19 08:23:27.249503 dv-cinder-813984-3-iscsi devstack@n-api.service[114088]: current working directory: / Oct 19 08:23:27.249503 dv-cinder-813984-3-iscsi devstack@n-api.service[114088]: detected binary path: /usr/bin/uwsgi-core Oct 19 08:23:27.250182 dv-cinder-813984-3-iscsi devstack@n-api.service[114088]: your processes number limit is 47680 Oct 19 08:23:27.250182 dv-cinder-813984-3-iscsi devstack@n-api.service[114088]: your memory page size is 4096 bytes Oct 19 08:23:27.250182 dv-cinder-813984-3-iscsi devstack@n-api.service[114088]: detected max file descriptor number: 2048 Oct 19 08:23:27.250182 dv-cinder-813984-3-iscsi devstack@n-api.service[114088]: lock engine: pthread robust mutexes Oct 19 08:23:27.250182 dv-cinder-813984-3-iscsi devstack@n-api.service[114088]: thunder lock: enabled Oct 19 08:23:27.250182 dv-cinder-813984-3-iscsi devstack@n-api.service[114088]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 19 08:23:27.250182 dv-cinder-813984-3-iscsi devstack@n-api.service[114088]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 19 08:23:27.295606 dv-cinder-813984-3-iscsi devstack@n-api.service[114088]: Python main interpreter initialized at 0x558e3e5079c0 Oct 19 08:23:27.295606 dv-cinder-813984-3-iscsi devstack@n-api.service[114088]: python threads support enabled Oct 19 08:23:27.295606 dv-cinder-813984-3-iscsi devstack@n-api.service[114088]: your server socket listen backlog is limited to 100 connections Oct 19 08:23:27.295606 dv-cinder-813984-3-iscsi devstack@n-api.service[114088]: your mercy for graceful operations on workers is 90 seconds Oct 19 08:23:27.296046 dv-cinder-813984-3-iscsi devstack@n-api.service[114088]: mapped 403077 bytes (393 KB) for 2 cores Oct 19 08:23:27.296046 dv-cinder-813984-3-iscsi devstack@n-api.service[114088]: *** Operational MODE: preforking *** Oct 19 08:23:27.296317 dv-cinder-813984-3-iscsi devstack@n-api.service[114088]: *** uWSGI is running in multiple interpreter mode *** Oct 19 08:23:27.296317 dv-cinder-813984-3-iscsi devstack@n-api.service[114088]: spawned uWSGI master process (pid: 114088) Oct 19 08:23:27.296513 dv-cinder-813984-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 19 08:23:27.298095 dv-cinder-813984-3-iscsi devstack@n-api.service[114088]: spawned uWSGI worker 1 (pid: 114105, cores: 1) Oct 19 08:23:27.298449 dv-cinder-813984-3-iscsi devstack@n-api.service[114088]: spawned uWSGI worker 2 (pid: 114106, cores: 1) Oct 19 08:23:27.298783 dv-cinder-813984-3-iscsi devstack@n-api.service[114088]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 19 08:23:29.104773 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 08:23:29.104773 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: from cryptography.utils import int_from_bytes Oct 19 08:23:29.105503 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 08:23:29.105503 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: from cryptography.utils import int_from_bytes Oct 19 08:23:29.114826 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 08:23:29.114826 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: from cryptography.utils import int_from_bytes Oct 19 08:23:29.115385 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 08:23:29.115385 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: from cryptography.utils import int_from_bytes Oct 19 08:23:31.689400 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 08:23:31.689942 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 08:23:31.690038 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 08:23:31.690417 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 08:23:31.690706 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 08:23:31.691108 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.691440 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.691767 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.692091 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.692425 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.692738 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.693062 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.693384 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.693713 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.693977 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.694295 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.694650 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813984-3-iscsi {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.694975 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.695288 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.695604 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.695928 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.696240 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.696566 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.696884 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.697391 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.698814 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.698814 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.698814 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.699187 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.699503 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.699819 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.700142 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.700460 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.700775 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.701630 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.702123 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813984-3-iscsi {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.702564 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.702890 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.703213 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.703333 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 08:23:31.703717 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 08:23:31.703801 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.704019 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.704130 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 08:23:31.704331 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.704441 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 08:23:31.704629 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.704727 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 08:23:31.704909 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.705016 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.705208 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.705322 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.705533 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.705653 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.705860 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.705981 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.706180 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.706303 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.706592 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.706728 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.706811 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.706894 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.707137 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.707250 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.707448 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.707641 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.707733 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.707817 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.708008 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.708114 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.708336 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813984-3-iscsi {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.708505 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.708649 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.708863 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.709013 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.709162 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.709318 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.709470 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.709630 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.709779 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.709928 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.710094 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.710248 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.710393 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.710573 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.710724 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.710872 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.711031 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.711197 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.711341 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.711489 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.711659 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.711813 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.711981 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.712142 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.712292 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.712465 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.712611 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.712763 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.712904 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.713053 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.713194 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.713335 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.713484 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.713646 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.713795 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.713936 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.714084 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.714233 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.714374 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.714584 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813984-3-iscsi {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.714735 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.714887 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.715028 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.715169 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.715319 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.715478 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.715631 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.715773 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.715922 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.716063 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.716214 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.716357 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.717666 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.717828 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.718032 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.718260 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.718260 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.718557 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.718729 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.718874 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.719023 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.719180 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.719323 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.719472 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.719614 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.719755 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.719904 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.720056 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.720198 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.720340 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.720524 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.720761 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.720921 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.721078 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.721220 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.721369 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.721519 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.721668 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.721827 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.721971 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.722113 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.722253 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.722409 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.722599 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.722758 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.722901 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.723042 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.723193 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.723342 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.723485 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.723638 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.723782 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.723922 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.724074 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.724222 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.724389 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.725090 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.725247 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.725404 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.725554 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.725712 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.725855 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.725995 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.726152 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.726568 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.727052 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.727222 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.727222 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.728026 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.728232 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.728386 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.728530 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.728677 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.728970 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.729151 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.729301 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.729442 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.729442 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.729719 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.729883 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.730063 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.730208 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.730351 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.730560 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.730716 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.730859 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.731007 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.731149 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.731290 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.731445 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.731594 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.731754 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.731905 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.732048 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.732189 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.732345 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.732499 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.732642 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.732790 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.732940 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.733092 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.733241 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.733390 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.733533 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.733690 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.733831 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.733987 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.734243 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.734405 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.734614 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.734772 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.734915 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.735071 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.735219 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.735361 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.735512 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.735655 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.735807 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.735957 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.736099 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.736248 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.736396 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.736539 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.736695 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.737170 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.737332 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.737709 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.738298 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.738460 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.738703 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.739030 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.739189 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.739333 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.739333 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.739633 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.739742 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.739829 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.739946 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.740068 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.740157 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.740240 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.740337 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.740421 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.740512 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.740595 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.740678 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.740768 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.740859 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.740951 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.741044 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.741127 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.741218 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.741309 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.741393 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.741475 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.741575 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.741666 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.741751 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.741834 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.741923 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.742006 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.742106 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.742190 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.742276 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.742357 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.742440 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.742587 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.742754 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.742841 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.742932 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.743015 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.743097 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.743187 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.743272 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.743272 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.743429 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.743519 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.743602 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.743693 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.743783 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.743867 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.743956 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.744047 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.744142 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.744235 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.744318 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.744400 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.744400 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.744546 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.744636 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.744719 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.744808 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.744898 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.744982 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.745071 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.745167 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.745251 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.745333 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.745414 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.745562 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.745662 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.745872 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.745971 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.746180 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.746308 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.746485 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.746655 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.746828 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 08:23:31.746972 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.747176 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.747326 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.747503 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.747636 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.747849 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.748466 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.748750 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.748843 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.749131 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.749236 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.749388 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.749490 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.749705 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.749799 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.750015 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.750115 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.750329 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.750421 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.750684 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.750792 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.750999 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.751097 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.751582 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.751683 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.751896 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.751998 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.752216 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.752322 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.752533 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.752626 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.752843 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.752937 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.753162 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.753264 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.753476 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.753568 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.753784 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.753874 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.754098 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.754198 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.754417 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.754561 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.754764 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.754857 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.755092 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.755207 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.755404 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.755499 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.755714 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.755970 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.756072 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.756321 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.756414 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.756637 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.756730 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.756950 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.757056 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.757266 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.757381 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.757584 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.757679 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.757896 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.758000 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.758212 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.758304 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.758547 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.758654 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.758916 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.759042 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.759195 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.759296 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.759508 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.759602 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.759829 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.759922 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.760146 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.760249 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.760456 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.760549 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.760763 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.760859 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.761072 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.761168 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.761379 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.761475 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.761693 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.761780 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.761995 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.762077 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.762303 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.762394 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.762635 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.762727 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.762945 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.763040 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.763252 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.763349 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.763656 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.763891 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.763976 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.764058 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.764267 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.764423 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.764572 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.764655 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.764886 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.764968 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.765198 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.765290 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.766525 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.766691 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.766804 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.766899 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.766997 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.767098 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.767189 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.767284 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.767284 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.767284 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.767511 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.767783 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.767915 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.768158 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.768268 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.768414 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.768524 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.768736 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.768915 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.769162 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.769322 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.769467 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.769620 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.769770 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.769918 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.770059 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.770210 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.770352 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.770556 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.771547 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.771642 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.771731 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.771807 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.771893 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.772069 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.772211 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.772361 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.772476 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.772662 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.772820 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.772967 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.773119 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.773261 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.773413 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.773559 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.773709 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.773849 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.773998 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.774146 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.774285 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.774427 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.774631 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.774783 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.774931 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.775085 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.775228 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.775373 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.775524 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.775664 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.775814 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.775953 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.776093 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.776244 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.776393 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.776533 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.776673 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.776822 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.776976 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.777129 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.777277 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.777277 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.777541 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.777621 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.777828 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.777828 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.778110 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.778110 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.778372 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.778538 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.778692 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.778851 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.779001 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.779766 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.780120 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.780299 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.780452 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.780594 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.780745 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.780887 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.781027 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.781167 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.781316 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.781469 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.781619 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.781761 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.781911 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.782059 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.782207 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.782377 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.782469 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.782593 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.782736 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.782833 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.783013 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.783100 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.783239 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.783409 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.783621 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.783621 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.783923 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.784072 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.784182 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.784284 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.784436 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.784661 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.784758 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.784993 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.785134 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.785312 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.785479 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.785667 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.785856 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.786008 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.786195 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.786359 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.786596 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.786741 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.786924 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.787076 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.787240 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.787395 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.787582 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.787698 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.787924 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.788030 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.788176 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.788314 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.788497 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.788648 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.788811 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.788969 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.789143 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.789296 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.789462 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.789603 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.789745 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.789998 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.790154 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.790295 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.790465 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.790602 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.790758 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.790905 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.791042 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.791186 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.791342 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.791500 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.791684 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.791821 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.792110 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.792265 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.792416 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.792557 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.792696 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.792835 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.792975 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.793133 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.793276 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.793417 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.793574 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.793722 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.793870 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.794018 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.794166 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.794308 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.794450 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.794614 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.794832 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.795048 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.795200 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.795342 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.795493 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.795634 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.795783 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.795924 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.796158 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.796303 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.796494 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.796636 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.796786 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.796934 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.797099 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.797242 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.797428 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.797578 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.797746 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.797883 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.798086 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.798233 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.798397 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.798570 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.798730 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.798870 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.799010 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.799106 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.799307 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.799448 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.799613 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.799708 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.799922 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.800092 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.800227 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.800327 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.800525 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.800620 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.800831 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.800922 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.801138 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.801245 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.801452 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.801545 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.801766 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.801858 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.802073 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.802191 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.802387 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.802506 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.802731 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.802837 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.803044 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.803145 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.803349 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.803449 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.803666 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.803768 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.803977 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.804069 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.804286 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.804378 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.804600 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.804702 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.804907 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.805006 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.805217 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.805324 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.805525 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.805619 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.805845 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.805946 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.806157 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.806263 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.806471 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.806627 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.806809 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.806911 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.807117 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.807220 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.807430 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.807525 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.807752 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.807843 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.808076 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.808321 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.808422 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.808657 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.808758 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.808971 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.809077 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.809286 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.809377 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.809598 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.809692 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.809905 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.810008 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.810220 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.810900 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.811070 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.811226 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.811429 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.811582 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.811783 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.811936 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.812077 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.812236 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.812388 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.812540 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.812680 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.812828 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.812975 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.813117 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.813267 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.813408 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.813555 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.813702 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.813850 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.813990 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.814150 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.814301 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.814442 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.814573 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.814781 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.814924 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.815128 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.815273 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.815435 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.815578 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.815749 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.815899 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.816040 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.816203 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.816352 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.816507 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.816654 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.816797 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.816944 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.817084 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.817231 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.817381 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.817521 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.817668 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.817836 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.817931 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.818212 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.818380 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.818545 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.818692 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.818832 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.818982 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.819137 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.819280 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.819420 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.819560 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.819701 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.819842 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.820002 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.820152 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.820282 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.820376 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.820575 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.820722 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.820878 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.821028 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.821169 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.821324 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.821463 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.821606 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.821822 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.821986 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.822136 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.822284 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.822378 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.822629 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.822774 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.822922 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.823063 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.823202 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.823348 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.823502 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.823643 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.823783 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.823932 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.824080 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.824227 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.824380 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.824656 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.824817 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.824966 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.825107 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.825246 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.825395 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.825536 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.825676 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.825825 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.826008 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.826008 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.826328 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.826470 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.826625 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.826770 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.826911 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.827065 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.827213 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.827359 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.827496 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.827637 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.827795 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.827952 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.828056 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.828200 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.828313 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.828532 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.828682 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.828786 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.828968 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.829106 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.829245 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.829393 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.829544 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.829636 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.829722 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.829949 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.830051 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.830254 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.830362 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.830590 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.830737 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.830902 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.830997 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.831207 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.831313 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.831517 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.831619 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.831841 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.831953 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.832156 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.832263 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.832460 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.832554 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.832770 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.832866 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.833076 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.833171 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.833380 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.833473 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.833684 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.833787 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.833991 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.834086 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.834294 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.834389 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.834637 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.834776 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.834928 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.835031 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.835232 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.835326 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.835537 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.835631 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.835848 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.835950 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.836155 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.836256 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.836459 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.836562 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.836766 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.836860 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.837069 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.837163 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.837381 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.837487 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.837692 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.837793 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.838008 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.838109 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.838319 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.838456 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.838674 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.838768 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.838996 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.839090 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.839310 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.839415 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.839623 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.839759 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.839939 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.840040 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.840243 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.840350 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.840559 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.840702 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.840877 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.840985 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.841186 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.841287 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.841491 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.841606 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.842377 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.842577 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.842815 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.842918 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.843133 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.843226 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.843442 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.843542 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.843753 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.843855 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.844070 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.844172 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.844393 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.844493 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.844700 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.844804 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.845007 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.845100 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.845317 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.845419 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.845629 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.845730 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.845939 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.846038 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.846246 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.846351 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.846582 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.846707 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.846898 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.847028 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.847212 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.847340 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.847523 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.847758 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.847852 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.848073 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.848165 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.848389 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.848493 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.848718 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.848865 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.849018 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.849167 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.849332 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.849476 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.849624 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.849765 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.849932 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.850037 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.850243 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.850337 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.850572 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.850680 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.850887 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.851058 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.851198 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.851293 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.851532 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.851624 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.851845 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.851948 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.852175 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.852277 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.852503 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.852604 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.852818 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.852921 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.853131 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.853233 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.853448 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.853555 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.853764 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.853859 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.854069 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.854164 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.854476 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.854623 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.854820 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.854957 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.855131 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.855231 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.855441 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.855535 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.855748 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.855841 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.856056 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.856156 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.856366 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.856469 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.856695 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.856789 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.857006 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.857107 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.857374 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.857487 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.857692 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.857853 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.858008 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.858181 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.858286 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.858505 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.858667 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.858839 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.858946 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.859231 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.859324 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.859559 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.859654 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.859865 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.859957 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.860189 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.860289 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.860516 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.860619 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.860825 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.860973 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.861152 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.861251 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.861466 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.861577 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.861778 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.861886 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.862090 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.862183 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.862401 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.862534 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.862743 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.862893 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.863069 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.863163 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.863393 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.863485 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.863704 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.863809 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.864020 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.864158 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.864327 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.864421 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.864653 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.864757 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.864978 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.865122 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.865294 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.865388 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.865616 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.865719 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.865956 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.866049 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.866263 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.866357 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.866600 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.866711 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.866917 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.867011 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.867226 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.867320 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.867536 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.867639 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.867844 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.867938 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.868156 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.868250 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.868462 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.868608 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.868765 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.868870 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.869071 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.869177 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.869381 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.869490 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.869694 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.869787 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.870010 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.870157 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.870321 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.870428 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.870646 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.870776 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.870952 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.871099 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.871259 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.871354 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.871572 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.871665 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.871895 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.871999 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.872210 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.872311 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.872534 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.872627 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.873381 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.873489 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.873698 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.873927 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.874089 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.874253 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.874357 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.874612 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.874711 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.874941 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.875048 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.875248 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.875363 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.875574 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.875666 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.875888 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.875981 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.876486 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.876594 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.876811 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.876906 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.877132 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.877234 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.877446 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.877547 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.877765 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.877902 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.878088 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.878185 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.878405 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.878551 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.878753 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.878954 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.879079 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.879292 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.879400 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.879615 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.879710 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.879935 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.880036 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.880258 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.880374 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.880565 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.880658 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.880876 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.881020 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.881190 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.881348 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.881492 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.881603 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.881806 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.881910 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.882110 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.882205 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.882432 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.882558 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.882766 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.882873 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.883091 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.883208 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.883401 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.883525 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.883708 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.883820 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.884014 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.884107 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.884319 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.884419 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.884662 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.884763 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.884966 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.885059 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.885302 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.885395 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.885623 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.885715 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.885945 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.886044 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.886269 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.886362 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.886604 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.886699 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.886924 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.887014 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.887242 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.887333 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.887559 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.887652 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.887874 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.887965 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.888189 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.888280 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.888519 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.888673 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.888866 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.889052 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.889313 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.889419 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.889631 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.889724 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.889951 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.890044 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.890272 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.890386 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.890618 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.890720 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.890992 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.891142 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.891315 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.891481 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.891801 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.891953 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.892120 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.892275 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.892428 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.892580 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.892730 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.892874 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.893016 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.893155 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.893311 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.893459 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.893625 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.893774 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.893918 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.894078 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.894228 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.894372 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.894551 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.894691 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.894879 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.895035 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.895205 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.895444 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.895591 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.895741 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.895883 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.896045 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.896188 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.896328 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.896468 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.896608 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.896748 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.896901 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.897106 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.897262 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.897427 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.897641 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.897796 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.897999 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.898145 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.898326 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.898472 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.898687 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.898836 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.899050 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.899160 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.899331 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.899436 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.899645 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.899754 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.899961 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.900062 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.900272 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.900424 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.900584 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.900704 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.900901 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.901011 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.901214 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.901315 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.901520 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.901633 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.901830 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.901951 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.902146 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.902250 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.902461 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.902591 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.902793 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.902889 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.903115 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.903210 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.903426 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.903629 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.903769 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.903948 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.904052 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.904924 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.905087 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.905237 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.905493 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.905609 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.905754 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.905858 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.906076 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.906178 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.906398 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.906522 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.906758 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.906935 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.907069 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.907172 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.907376 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.907477 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.907688 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.907794 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.907994 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.908094 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.908297 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.908390 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.908608 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.908702 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.908919 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.909012 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.909253 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.909357 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.909539 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.909644 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.909847 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.909940 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.910153 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.910380 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.910561 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.910759 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.910888 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.911115 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.911218 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.911432 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.911548 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.911746 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.911875 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.912097 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.912202 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.912419 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.912521 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.912797 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.912957 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.913113 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.913297 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.913410 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.913672 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.913775 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.914022 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.914126 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.914328 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.914531 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.914661 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.914769 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.914976 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.915070 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.915285 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.915394 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.915594 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.915714 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.915907 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.916017 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.916212 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.916321 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.916526 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.916634 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.916832 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.916931 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.917137 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.917247 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.917441 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.917550 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.917754 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.917854 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.918060 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.918206 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.918365 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.918466 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.918696 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.918811 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.919000 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.919094 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.919315 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.919418 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.919617 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.919719 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.919979 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.920088 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.920321 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.920412 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.920640 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.920755 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.920954 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.921056 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.921265 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.921356 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.921574 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.921678 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.921900 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.921997 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.922208 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.922304 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.922532 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.922631 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.922853 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.922945 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.923169 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.923273 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.923492 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.923586 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.923807 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.923912 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.924123 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.924241 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.924469 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.924570 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.924789 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.924882 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.925125 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.925324 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.925453 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.925661 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.925806 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.926029 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.926130 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.926375 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.926470 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.926745 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.926840 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.927056 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.927148 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.927366 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.927460 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.927675 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.927768 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.927981 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.928072 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.928310 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.928411 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.928609 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.928708 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.928923 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.929028 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.929222 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.929522 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.929630 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.929717 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.929836 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.929940 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.930154 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.930323 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.930473 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.930640 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.930783 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.930912 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.931119 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.931215 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.931437 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.931544 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.931753 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.931876 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.932074 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.932194 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.932388 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.932613 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.932770 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.932911 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.933059 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.933200 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.933359 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.933506 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.933656 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.933799 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.933940 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.934080 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.934319 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.934462 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.934647 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.934739 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.934824 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.934915 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.935184 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.935291 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.936020 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.936233 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.936326 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.936581 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.936679 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.936911 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.937014 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.937231 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.937331 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.937560 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.937660 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.937874 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.937967 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.938191 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.938365 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.938527 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.938636 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.938852 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.938944 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.939181 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.939279 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.939574 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.939683 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.939840 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.939932 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.940164 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.940255 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.940474 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.940580 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.940786 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.940911 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.941090 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.941194 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.941401 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.941511 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.941697 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 08:23:31.941806 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.942036 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.942361 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.942701 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.943029 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.943340 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.943663 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.944000 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.944297 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.944609 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.944943 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.945254 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.945568 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.945880 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.946193 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.946522 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.946833 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.947164 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.947495 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.947803 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.948128 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.948447 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.948767 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.949084 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.949399 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.949734 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.950046 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.950365 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.950712 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.951108 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.951434 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.951757 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.952082 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.952409 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.952737 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.953071 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.953417 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.953735 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.954081 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.954412 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 08:23:31.954680 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 08:23:31.964205 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_db.sqlalchemy.engines [None req-fb7aa70d-1b82-47f9-ae7f-2eb218edb20b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114105) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 08:23:31.977168 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_db.sqlalchemy.engines [None req-84709430-3cde-4763-b1fa-0a5df748b2a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114106) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 08:23:32.044427 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.context [None req-fb7aa70d-1b82-47f9-ae7f-2eb218edb20b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6604bbba-8828-47eb-a883-0d318e12f828(cell1) {{(pid=114105) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 08:23:32.049552 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fb7aa70d-1b82-47f9-ae7f-2eb218edb20b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:23:32.051217 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fb7aa70d-1b82-47f9-ae7f-2eb218edb20b None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:23:32.052040 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fb7aa70d-1b82-47f9-ae7f-2eb218edb20b None None] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:23:32.053981 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fb7aa70d-1b82-47f9-ae7f-2eb218edb20b None None] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:23:32.056233 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.context [None req-84709430-3cde-4763-b1fa-0a5df748b2a4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6604bbba-8828-47eb-a883-0d318e12f828(cell1) {{(pid=114106) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 08:23:32.060925 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-84709430-3cde-4763-b1fa-0a5df748b2a4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:23:32.062371 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-84709430-3cde-4763-b1fa-0a5df748b2a4 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:23:32.063268 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-84709430-3cde-4763-b1fa-0a5df748b2a4 None None] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:23:32.064463 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_db.sqlalchemy.engines [None req-fb7aa70d-1b82-47f9-ae7f-2eb218edb20b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114105) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 08:23:32.065251 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-84709430-3cde-4763-b1fa-0a5df748b2a4 None None] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:23:32.065801 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_db.sqlalchemy.engines [None req-fb7aa70d-1b82-47f9-ae7f-2eb218edb20b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114105) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 08:23:32.076591 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_db.sqlalchemy.engines [None req-84709430-3cde-4763-b1fa-0a5df748b2a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114106) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 08:23:32.077446 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_db.sqlalchemy.engines [None req-84709430-3cde-4763-b1fa-0a5df748b2a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114106) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 08:23:32.332170 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_db.sqlalchemy.engines [None req-fb7aa70d-1b82-47f9-ae7f-2eb218edb20b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114105) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 08:23:32.338954 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_db.sqlalchemy.engines [None req-84709430-3cde-4763-b1fa-0a5df748b2a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114106) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 08:23:32.664264 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: WARNING keystonemiddleware.auth_token [None req-fb7aa70d-1b82-47f9-ae7f-2eb218edb20b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 08:23:32.671075 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: WARNING keystonemiddleware.auth_token [None req-fb7aa70d-1b82-47f9-ae7f-2eb218edb20b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 08:23:32.671987 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: WARNING keystonemiddleware.auth_token [None req-84709430-3cde-4763-b1fa-0a5df748b2a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 08:23:32.678628 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: WARNING keystonemiddleware.auth_token [None req-84709430-3cde-4763-b1fa-0a5df748b2a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 08:23:33.022381 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: WARNING keystonemiddleware.auth_token [None req-fb7aa70d-1b82-47f9-ae7f-2eb218edb20b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 08:23:33.027686 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: WARNING keystonemiddleware.auth_token [None req-fb7aa70d-1b82-47f9-ae7f-2eb218edb20b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 08:23:33.027903 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: WARNING keystonemiddleware.auth_token [None req-84709430-3cde-4763-b1fa-0a5df748b2a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 08:23:33.033475 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558e3e5079c0 pid: 114105 (default app) Oct 19 08:23:33.033937 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: WARNING keystonemiddleware.auth_token [None req-84709430-3cde-4763-b1fa-0a5df748b2a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 08:23:33.039092 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558e3e5079c0 pid: 114106 (default app) Oct 19 08:24:05.099692 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-bd7786cc-261c-458a-9067-9b12cb50a8db tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] Action: 'create', calling method: .version_select at 0x7fcadf10b160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-300912544"}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:24:06.254277 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-afdf1347-4d75-47c9-ac6e-167c9f421caa tempest-VolumesGetTestJSON-88464437 tempest-VolumesGetTestJSON-88464437-project] Action: 'create', calling method: .version_select at 0x7fcadf10c160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-41645063", "metadata": {"Type": "work"}}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:24:07.415902 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-bd7786cc-261c-458a-9067-9b12cb50a8db tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.005036 Oct 19 08:24:07.416522 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1154 bytes} [Tue Oct 19 08:24:04 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 3008 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 19 08:24:07.477741 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-afdf1347-4d75-47c9-ac6e-167c9f421caa tempest-VolumesGetTestJSON-88464437 tempest-VolumesGetTestJSON-88464437-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 2.097586 Oct 19 08:24:07.478626 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 1/2] 10.222.0.26 () {60 vars in 1155 bytes} [Tue Oct 19 08:24:05 2021] POST /compute/v2.1/os-volumes => generated 351 bytes in 2100 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 19 08:24:07.484933 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-4f8ee8fa-2747-49c4-9c1a-5bdedd738e4e tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] Calling method '.version_select at 0x7fcadefc8d30>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:07.525842 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-6089bde7-e593-493b-b3e6-2f79bc34984d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-604241990", "imageRef": "9102a998-a580-4b4e-b6a1-3172273dd66d", "flavorRef": "452", "networks": [{"uuid": "208569bb-7601-4f08-96d0-ae2bdee2d6b5"}]}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:24:07.577828 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-4f8ee8fa-2747-49c4-9c1a-5bdedd738e4e tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/51957b69-c0c9-4738-8ecd-bc74683372bd" status: 200 len: 344 microversion: 2.1 time: 0.097646 Oct 19 08:24:07.578979 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1244 bytes} [Tue Oct 19 08:24:07 2021] GET /compute/v2.1/os-volumes/51957b69-c0c9-4738-8ecd-bc74683372bd => generated 344 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:24:07.583666 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-4eefba8f-8779-4760-82db-0f8d7b5032eb tempest-VolumesGetTestJSON-88464437 tempest-VolumesGetTestJSON-88464437-project] Calling method '.version_select at 0x7fcadefc8f70>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:07.657280 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-4eefba8f-8779-4760-82db-0f8d7b5032eb tempest-VolumesGetTestJSON-88464437 tempest-VolumesGetTestJSON-88464437-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/5487896e-ddef-47db-b2d2-810f36ead7c7" status: 200 len: 351 microversion: 2.1 time: 0.077113 Oct 19 08:24:07.658891 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 3/4] 10.222.0.26 () {58 vars in 1244 bytes} [Tue Oct 19 08:24:07 2021] GET /compute/v2.1/os-volumes/5487896e-ddef-47db-b2d2-810f36ead7c7 => generated 351 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:24:07.709541 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.network.neutron [None req-6089bde7-e593-493b-b3e6-2f79bc34984d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] validate_networks() for [('208569bb-7601-4f08-96d0-ae2bdee2d6b5', None, None, None, None, None)] {{(pid=114105) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 19 08:24:08.581112 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-7a408880-dbe4-4721-94d6-12df81af5e11 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-584350681", "imageRef": "9102a998-a580-4b4e-b6a1-3172273dd66d", "flavorRef": "452", "networks": [{"uuid": "fbed0243-7d71-4fc4-9caf-afbd08f9b31f"}]}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:24:08.741303 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.network.neutron [None req-7a408880-dbe4-4721-94d6-12df81af5e11 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] validate_networks() for [('fbed0243-7d71-4fc4-9caf-afbd08f9b31f', None, None, None, None, None)] {{(pid=114106) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 19 08:24:09.548187 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-6089bde7-e593-493b-b3e6-2f79bc34984d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Flavor limits 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 08:24:09.549202 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-6089bde7-e593-493b-b3e6-2f79bc34984d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Image limits 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 08:24:09.549948 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-6089bde7-e593-493b-b3e6-2f79bc34984d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Flavor pref 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 08:24:09.550628 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-6089bde7-e593-493b-b3e6-2f79bc34984d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Image pref 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 08:24:09.551208 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-6089bde7-e593-493b-b3e6-2f79bc34984d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 08:24:09.582473 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6089bde7-e593-493b-b3e6-2f79bc34984d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:09.592488 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6089bde7-e593-493b-b3e6-2f79bc34984d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:09.593390 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6089bde7-e593-493b-b3e6-2f79bc34984d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:09.593821 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6089bde7-e593-493b-b3e6-2f79bc34984d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:09.648956 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-6089bde7-e593-493b-b3e6-2f79bc34984d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Getting quotas for project 28699d0a84f047ef8e686a6a7d0035fc. Resources: {'cores', 'instances', 'ram'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:24:09.660520 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-6089bde7-e593-493b-b3e6-2f79bc34984d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Getting quotas for user 5933523d36e048269aaaa34dd1fd5c65 and project 28699d0a84f047ef8e686a6a7d0035fc. Resources: {'cores', 'instances', 'ram'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:24:09.674317 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-6089bde7-e593-493b-b3e6-2f79bc34984d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Going to run 1 instances... {{(pid=114105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 19 08:24:09.677454 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-6089bde7-e593-493b-b3e6-2f79bc34984d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9102a998-a580-4b4e-b6a1-3172273dd66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 19 08:24:09.824128 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-6089bde7-e593-493b-b3e6-2f79bc34984d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.405883 Oct 19 08:24:09.834573 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 2/5] 10.222.0.26 () {60 vars in 1146 bytes} [Tue Oct 19 08:24:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 2417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 08:24:09.851092 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-7373de20-a06a-4284-aeef-59146e72db27 tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] Calling method '.version_select at 0x7fcade6654c0>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:09.985762 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-7373de20-a06a-4284-aeef-59146e72db27 tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/51957b69-c0c9-4738-8ecd-bc74683372bd" status: 200 len: 345 microversion: 2.1 time: 0.148422 Oct 19 08:24:09.986661 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 3/6] 10.222.0.26 () {58 vars in 1244 bytes} [Tue Oct 19 08:24:09 2021] GET /compute/v2.1/os-volumes/51957b69-c0c9-4738-8ecd-bc74683372bd => generated 345 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:24:09.991677 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-970af4b9-1fb0-4f3d-b6e5-b42bbc3a907f tempest-VolumesGetTestJSON-88464437 tempest-VolumesGetTestJSON-88464437-project] Calling method '.version_select at 0x7fcade67c160>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:10.104024 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-970af4b9-1fb0-4f3d-b6e5-b42bbc3a907f tempest-VolumesGetTestJSON-88464437 tempest-VolumesGetTestJSON-88464437-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/5487896e-ddef-47db-b2d2-810f36ead7c7" status: 200 len: 352 microversion: 2.1 time: 0.115774 Oct 19 08:24:10.113117 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1244 bytes} [Tue Oct 19 08:24:09 2021] GET /compute/v2.1/os-volumes/5487896e-ddef-47db-b2d2-810f36ead7c7 => generated 352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:24:10.113117 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d0bbb2f0-0c44-42d7-b815-ec26c106cb76 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:10.113117 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-d0bbb2f0-0c44-42d7-b815-ec26c106cb76 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:10.273234 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-d0bbb2f0-0c44-42d7-b815-ec26c106cb76 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:10.291472 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-d0bbb2f0-0c44-42d7-b815-ec26c106cb76 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1214 microversion: 2.1 time: 0.185610 Oct 19 08:24:10.305510 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 5/8] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:10 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1214 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:10.310228 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-9abb1dff-4341-4ae7-befa-f78dc6072a39 tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] Action: 'create', calling method: .version_select at 0x7fcade6960d0>, body: {"snapshot": {"volume_id": "51957b69-c0c9-4738-8ecd-bc74683372bd", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1524886592"}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:24:10.812623 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-9abb1dff-4341-4ae7-befa-f78dc6072a39 tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.505939 Oct 19 08:24:10.813946 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 6/9] 10.222.0.26 () {60 vars in 1161 bytes} [Tue Oct 19 08:24:10 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:24:10.818865 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-64a89f4e-6a7f-4f76-a846-09ed0ff88e5e tempest-VolumesGetTestJSON-88464437 tempest-VolumesGetTestJSON-88464437-project] Calling method '.version_select at 0x7fcade696d30>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:10.948288 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-64a89f4e-6a7f-4f76-a846-09ed0ff88e5e tempest-VolumesGetTestJSON-88464437 tempest-VolumesGetTestJSON-88464437-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/5487896e-ddef-47db-b2d2-810f36ead7c7" status: 200 len: 352 microversion: 2.1 time: 0.133110 Oct 19 08:24:10.953252 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 7/10] 10.222.0.26 () {58 vars in 1244 bytes} [Tue Oct 19 08:24:10 2021] GET /compute/v2.1/os-volumes/5487896e-ddef-47db-b2d2-810f36ead7c7 => generated 352 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:24:10.959910 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-13297b16-4d0a-4458-ae9c-527b0bac7f47 tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] Calling method '.version_select at 0x7fcadde2e310>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:11.041781 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-13297b16-4d0a-4458-ae9c-527b0bac7f47 tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/979b19aa-e37e-405a-b5df-3b9a1b8a1f36" status: 200 len: 287 microversion: 2.1 time: 0.086906 Oct 19 08:24:11.043061 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 8/11] 10.222.0.26 () {58 vars in 1250 bytes} [Tue Oct 19 08:24:10 2021] GET /compute/v2.1/os-snapshots/979b19aa-e37e-405a-b5df-3b9a1b8a1f36 => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:24:11.048032 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-40f947b8-6e68-445c-9159-2978a5bdf3c5 tempest-VolumesGetTestJSON-88464437 tempest-VolumesGetTestJSON-88464437-project] Calling method '.version_select at 0x7fcadde2ea60>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:11.175768 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-40f947b8-6e68-445c-9159-2978a5bdf3c5 tempest-VolumesGetTestJSON-88464437 tempest-VolumesGetTestJSON-88464437-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/5487896e-ddef-47db-b2d2-810f36ead7c7" status: 202 len: 0 microversion: 2.1 time: 0.131363 Oct 19 08:24:11.177069 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 9/12] 10.222.0.26 () {58 vars in 1247 bytes} [Tue Oct 19 08:24:11 2021] DELETE /compute/v2.1/os-volumes/5487896e-ddef-47db-b2d2-810f36ead7c7 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:24:11.183327 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-b439140d-2d92-4f69-a83e-14ab80a7410b tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] Calling method '.version_select at 0x7fcadde2eca0>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:11.244787 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-b439140d-2d92-4f69-a83e-14ab80a7410b tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.066391 Oct 19 08:24:11.245361 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 10/13] 10.222.0.26 () {58 vars in 1139 bytes} [Tue Oct 19 08:24:11 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:24:11.250806 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-e9760bb9-3209-4f9b-bf56-52fbeeafce71 tempest-VolumesGetTestJSON-88464437 tempest-VolumesGetTestJSON-88464437-project] Calling method '.version_select at 0x7fcadf94a790>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:11.317820 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-e9760bb9-3209-4f9b-bf56-52fbeeafce71 tempest-VolumesGetTestJSON-88464437 tempest-VolumesGetTestJSON-88464437-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/5487896e-ddef-47db-b2d2-810f36ead7c7" status: 200 len: 351 microversion: 2.1 time: 0.071063 Oct 19 08:24:11.318396 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 11/14] 10.222.0.26 () {58 vars in 1244 bytes} [Tue Oct 19 08:24:11 2021] GET /compute/v2.1/os-volumes/5487896e-ddef-47db-b2d2-810f36ead7c7 => generated 351 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:24:11.326339 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-900fcd8d-7415-4e04-9402-c9d004f1598b tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] Calling method '.version_select at 0x7fcadde360d0>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:11.362092 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-900fcd8d-7415-4e04-9402-c9d004f1598b tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/979b19aa-e37e-405a-b5df-3b9a1b8a1f36" status: 200 len: 287 microversion: 2.1 time: 0.042048 Oct 19 08:24:11.366382 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 12/15] 10.222.0.26 () {58 vars in 1250 bytes} [Tue Oct 19 08:24:11 2021] GET /compute/v2.1/os-snapshots/979b19aa-e37e-405a-b5df-3b9a1b8a1f36 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:24:11.373530 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8796544c-bec6-4067-a62f-7679b74ec07f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:11.376229 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-8796544c-bec6-4067-a62f-7679b74ec07f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:11.549363 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-8796544c-bec6-4067-a62f-7679b74ec07f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:11.569307 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-8796544c-bec6-4067-a62f-7679b74ec07f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1214 microversion: 2.1 time: 0.197095 Oct 19 08:24:11.570298 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 13/16] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:11 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1214 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:11.687696 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-7a408880-dbe4-4721-94d6-12df81af5e11 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Flavor limits 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 08:24:11.687696 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-7a408880-dbe4-4721-94d6-12df81af5e11 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Image limits 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 08:24:11.688186 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-7a408880-dbe4-4721-94d6-12df81af5e11 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Flavor pref 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 08:24:11.688401 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-7a408880-dbe4-4721-94d6-12df81af5e11 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Image pref 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 08:24:11.689008 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-7a408880-dbe4-4721-94d6-12df81af5e11 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 08:24:11.703185 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7a408880-dbe4-4721-94d6-12df81af5e11 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:11.703620 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7a408880-dbe4-4721-94d6-12df81af5e11 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:11.704420 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7a408880-dbe4-4721-94d6-12df81af5e11 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:11.704830 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7a408880-dbe4-4721-94d6-12df81af5e11 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:11.741715 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-7a408880-dbe4-4721-94d6-12df81af5e11 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Getting quotas for project d1e6b0972cf140649ed2cad14f2db0b4. Resources: {'cores', 'instances', 'ram'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:24:11.749733 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-7a408880-dbe4-4721-94d6-12df81af5e11 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Getting quotas for user bb3db95dc956487ead5e579b58451580 and project d1e6b0972cf140649ed2cad14f2db0b4. Resources: {'cores', 'instances', 'ram'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:24:11.763818 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-7a408880-dbe4-4721-94d6-12df81af5e11 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Going to run 1 instances... {{(pid=114106) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 19 08:24:11.766767 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-7a408880-dbe4-4721-94d6-12df81af5e11 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9102a998-a580-4b4e-b6a1-3172273dd66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114106) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 19 08:24:11.865666 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-7a408880-dbe4-4721-94d6-12df81af5e11 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.394335 Oct 19 08:24:11.869994 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 4/17] 10.222.0.26 () {60 vars in 1146 bytes} [Tue Oct 19 08:24:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 3400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 08:24:11.878356 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-88cda5f5-a28e-4867-842e-2283466612f9 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:11.879038 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-88cda5f5-a28e-4867-842e-2283466612f9 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:11.976273 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-88cda5f5-a28e-4867-842e-2283466612f9 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:11.986659 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-88cda5f5-a28e-4867-842e-2283466612f9 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1217 microversion: 2.1 time: 0.113101 Oct 19 08:24:11.990029 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 14/18] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:11 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1217 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:12.329871 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-af10b4ab-2486-4167-ae7f-9f5dec025032 tempest-VolumesGetTestJSON-88464437 tempest-VolumesGetTestJSON-88464437-project] Calling method '.version_select at 0x7fcade666550>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:12.375405 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-92173f89-bc91-4572-bae9-c5f400e83db7 tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] Calling method '.version_select at 0x7fcadde2e790>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:12.405899 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-af10b4ab-2486-4167-ae7f-9f5dec025032 tempest-VolumesGetTestJSON-88464437 tempest-VolumesGetTestJSON-88464437-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/5487896e-ddef-47db-b2d2-810f36ead7c7" status: 200 len: 351 microversion: 2.1 time: 0.080055 Oct 19 08:24:12.407127 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 5/19] 10.222.0.26 () {58 vars in 1244 bytes} [Tue Oct 19 08:24:12 2021] GET /compute/v2.1/os-volumes/5487896e-ddef-47db-b2d2-810f36ead7c7 => generated 351 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:24:12.501209 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-92173f89-bc91-4572-bae9-c5f400e83db7 tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/979b19aa-e37e-405a-b5df-3b9a1b8a1f36" status: 200 len: 287 microversion: 2.1 time: 0.131660 Oct 19 08:24:12.502233 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 15/20] 10.222.0.26 () {58 vars in 1250 bytes} [Tue Oct 19 08:24:12 2021] GET /compute/v2.1/os-snapshots/979b19aa-e37e-405a-b5df-3b9a1b8a1f36 => generated 287 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:24:12.595922 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a59651f4-12c2-4ec8-b0f9-fab092cefeb7 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:12.596763 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a59651f4-12c2-4ec8-b0f9-fab092cefeb7 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:12.621550 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a59651f4-12c2-4ec8-b0f9-fab092cefeb7 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:12.625268 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a59651f4-12c2-4ec8-b0f9-fab092cefeb7 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:12.626324 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a59651f4-12c2-4ec8-b0f9-fab092cefeb7 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:12.629269 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a59651f4-12c2-4ec8-b0f9-fab092cefeb7 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:12.822295 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a59651f4-12c2-4ec8-b0f9-fab092cefeb7 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:12.839134 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a59651f4-12c2-4ec8-b0f9-fab092cefeb7 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1218 microversion: 2.1 time: 0.247231 Oct 19 08:24:12.839977 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 6/21] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:12 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1218 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:24:13.004996 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-a8cccc19-fd65-44f5-b0f9-d81b92a209ae tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:13.006190 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-a8cccc19-fd65-44f5-b0f9-d81b92a209ae tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:13.020756 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a8cccc19-fd65-44f5-b0f9-d81b92a209ae tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:13.021438 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a8cccc19-fd65-44f5-b0f9-d81b92a209ae tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:13.022423 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a8cccc19-fd65-44f5-b0f9-d81b92a209ae tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:13.022880 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a8cccc19-fd65-44f5-b0f9-d81b92a209ae tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:13.219484 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-a8cccc19-fd65-44f5-b0f9-d81b92a209ae tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:13.231537 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-a8cccc19-fd65-44f5-b0f9-d81b92a209ae tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1221 microversion: 2.1 time: 0.230435 Oct 19 08:24:13.232183 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 16/22] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:12 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1221 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:13.418697 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b28fef26-c1e4-4884-b292-a67753486166 tempest-VolumesGetTestJSON-88464437 tempest-VolumesGetTestJSON-88464437-project] Calling method '.version_select at 0x7fcadddfbd30>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:13.468971 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b28fef26-c1e4-4884-b292-a67753486166 tempest-VolumesGetTestJSON-88464437 tempest-VolumesGetTestJSON-88464437-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/5487896e-ddef-47db-b2d2-810f36ead7c7" status: 200 len: 351 microversion: 2.1 time: 0.053841 Oct 19 08:24:13.469732 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 7/23] 10.222.0.26 () {58 vars in 1244 bytes} [Tue Oct 19 08:24:13 2021] GET /compute/v2.1/os-volumes/5487896e-ddef-47db-b2d2-810f36ead7c7 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:24:13.513825 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-764d67e8-a6fa-4408-95ad-3f79103274c7 tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] Calling method '.version_select at 0x7fcaddd99e50>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:13.549675 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-764d67e8-a6fa-4408-95ad-3f79103274c7 tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/979b19aa-e37e-405a-b5df-3b9a1b8a1f36" status: 200 len: 287 microversion: 2.1 time: 0.040239 Oct 19 08:24:13.550727 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 17/24] 10.222.0.26 () {58 vars in 1250 bytes} [Tue Oct 19 08:24:13 2021] GET /compute/v2.1/os-snapshots/979b19aa-e37e-405a-b5df-3b9a1b8a1f36 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:24:13.857049 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c0773e3f-cebe-42bd-aded-e07fea80ebd3 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:13.857895 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c0773e3f-cebe-42bd-aded-e07fea80ebd3 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:13.864807 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c0773e3f-cebe-42bd-aded-e07fea80ebd3 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:13.865481 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c0773e3f-cebe-42bd-aded-e07fea80ebd3 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:13.866616 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c0773e3f-cebe-42bd-aded-e07fea80ebd3 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:13.867207 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c0773e3f-cebe-42bd-aded-e07fea80ebd3 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:14.099017 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-c0773e3f-cebe-42bd-aded-e07fea80ebd3 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:14.109793 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c0773e3f-cebe-42bd-aded-e07fea80ebd3 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1218 microversion: 2.1 time: 0.254283 Oct 19 08:24:14.120053 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 8/25] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:13 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1218 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:14.249365 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c0b921f9-e1ee-406e-a956-b6cd1fc9997e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:14.250223 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-c0b921f9-e1ee-406e-a956-b6cd1fc9997e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:14.258849 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c0b921f9-e1ee-406e-a956-b6cd1fc9997e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:14.259381 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c0b921f9-e1ee-406e-a956-b6cd1fc9997e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:14.260298 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c0b921f9-e1ee-406e-a956-b6cd1fc9997e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:14.260945 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c0b921f9-e1ee-406e-a956-b6cd1fc9997e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:14.388349 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-c0b921f9-e1ee-406e-a956-b6cd1fc9997e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:14.397004 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-c0b921f9-e1ee-406e-a956-b6cd1fc9997e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1221 microversion: 2.1 time: 0.152020 Oct 19 08:24:14.398406 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 18/26] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:14 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1221 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:14.482706 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-2ef69c87-cfa2-4d05-a7dd-f03c0bc741d2 tempest-VolumesGetTestJSON-88464437 tempest-VolumesGetTestJSON-88464437-project] Calling method '.version_select at 0x7fcadddfbe50>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:14.540685 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-2ef69c87-cfa2-4d05-a7dd-f03c0bc741d2 tempest-VolumesGetTestJSON-88464437 tempest-VolumesGetTestJSON-88464437-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/5487896e-ddef-47db-b2d2-810f36ead7c7" status: 200 len: 351 microversion: 2.1 time: 0.063324 Oct 19 08:24:14.541653 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 9/27] 10.222.0.26 () {58 vars in 1244 bytes} [Tue Oct 19 08:24:14 2021] GET /compute/v2.1/os-volumes/5487896e-ddef-47db-b2d2-810f36ead7c7 => generated 351 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:24:14.562093 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-1bc03fe4-fe5e-43d2-a5c8-6c041e563f29 tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] Calling method '.version_select at 0x7fcadf94a550>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:14.602873 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-1bc03fe4-fe5e-43d2-a5c8-6c041e563f29 tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/979b19aa-e37e-405a-b5df-3b9a1b8a1f36" status: 200 len: 287 microversion: 2.1 time: 0.045381 Oct 19 08:24:14.603680 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 19/28] 10.222.0.26 () {58 vars in 1250 bytes} [Tue Oct 19 08:24:14 2021] GET /compute/v2.1/os-snapshots/979b19aa-e37e-405a-b5df-3b9a1b8a1f36 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:24:15.128445 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-71591c31-4d8b-4856-99c3-fcfa574b3d5f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:15.129065 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-71591c31-4d8b-4856-99c3-fcfa574b3d5f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:15.139815 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-71591c31-4d8b-4856-99c3-fcfa574b3d5f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:15.140261 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-71591c31-4d8b-4856-99c3-fcfa574b3d5f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:15.141049 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-71591c31-4d8b-4856-99c3-fcfa574b3d5f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:15.144802 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-71591c31-4d8b-4856-99c3-fcfa574b3d5f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:15.337068 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-71591c31-4d8b-4856-99c3-fcfa574b3d5f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:15.346386 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-71591c31-4d8b-4856-99c3-fcfa574b3d5f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1210 microversion: 2.1 time: 0.222644 Oct 19 08:24:15.357218 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 10/29] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:15 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1210 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:15.418766 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-5e96270b-660f-427b-b4d7-dfefa0dd4ab1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:15.420272 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-5e96270b-660f-427b-b4d7-dfefa0dd4ab1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:15.447156 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5e96270b-660f-427b-b4d7-dfefa0dd4ab1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:15.452604 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5e96270b-660f-427b-b4d7-dfefa0dd4ab1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:15.455150 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5e96270b-660f-427b-b4d7-dfefa0dd4ab1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:15.456106 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5e96270b-660f-427b-b4d7-dfefa0dd4ab1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:15.553257 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-d23c03c8-9a86-4c58-b485-f0f86d414abb tempest-VolumesGetTestJSON-88464437 tempest-VolumesGetTestJSON-88464437-project] Calling method '.version_select at 0x7fcadddd71f0>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:15.650446 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-d23c03c8-9a86-4c58-b485-f0f86d414abb tempest-VolumesGetTestJSON-88464437 tempest-VolumesGetTestJSON-88464437-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/5487896e-ddef-47db-b2d2-810f36ead7c7" status: 200 len: 351 microversion: 2.1 time: 0.100776 Oct 19 08:24:15.651363 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 11/30] 10.222.0.26 () {58 vars in 1244 bytes} [Tue Oct 19 08:24:15 2021] GET /compute/v2.1/os-volumes/5487896e-ddef-47db-b2d2-810f36ead7c7 => generated 351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 08:24:15.656665 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-53651057-5ebf-431c-a4b4-d72d8a56e1a1 tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] Calling method '.version_select at 0x7fcadddfbaf0>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:15.708289 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-5e96270b-660f-427b-b4d7-dfefa0dd4ab1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:15.716379 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-5e96270b-660f-427b-b4d7-dfefa0dd4ab1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1221 microversion: 2.1 time: 0.306337 Oct 19 08:24:15.717142 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-53651057-5ebf-431c-a4b4-d72d8a56e1a1 tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/979b19aa-e37e-405a-b5df-3b9a1b8a1f36" status: 200 len: 287 microversion: 2.1 time: 0.064215 Oct 19 08:24:15.720169 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 20/31] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:15 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1221 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:15.722081 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 12/32] 10.222.0.26 () {58 vars in 1250 bytes} [Tue Oct 19 08:24:15 2021] GET /compute/v2.1/os-snapshots/979b19aa-e37e-405a-b5df-3b9a1b8a1f36 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:24:15.788801 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-b214f834-ef5f-446c-a830-6bb5cfb33cb1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'create', calling method: .version_select at 0x7fcadddc6e50>, body: {"keypair": {"name": "tempest-keypair-510185428"}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:24:15.846614 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-b214f834-ef5f-446c-a830-6bb5cfb33cb1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Getting quotas for project 6ffc881ce1324822826aec5e72a754b4. Resources: {'key_pairs'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:24:15.852536 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-b214f834-ef5f-446c-a830-6bb5cfb33cb1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Getting quotas for user 3ba4c5d03e21424eb9b326bddefbf34a and project 6ffc881ce1324822826aec5e72a754b4. Resources: {'key_pairs'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:24:16.365678 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-000d8521-fe54-4a97-8b8b-dd801e4e7ed3 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:16.366446 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-000d8521-fe54-4a97-8b8b-dd801e4e7ed3 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:16.390802 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-000d8521-fe54-4a97-8b8b-dd801e4e7ed3 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:16.392948 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-000d8521-fe54-4a97-8b8b-dd801e4e7ed3 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:16.405385 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-000d8521-fe54-4a97-8b8b-dd801e4e7ed3 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:16.406107 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-000d8521-fe54-4a97-8b8b-dd801e4e7ed3 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:16.609321 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-000d8521-fe54-4a97-8b8b-dd801e4e7ed3 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:16.619246 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-000d8521-fe54-4a97-8b8b-dd801e4e7ed3 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1266 microversion: 2.1 time: 0.258299 Oct 19 08:24:16.625730 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 13/33] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:16 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1266 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:16.663091 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-5e664e01-a9da-489e-9a31-46827324d057 tempest-VolumesGetTestJSON-88464437 tempest-VolumesGetTestJSON-88464437-project] Calling method '.version_select at 0x7fcadddd7550>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:16.719113 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.wsgi [None req-5e664e01-a9da-489e-9a31-46827324d057 tempest-VolumesGetTestJSON-88464437 tempest-VolumesGetTestJSON-88464437-project] HTTP exception thrown: Volume 5487896e-ddef-47db-b2d2-810f36ead7c7 could not be found. Oct 19 08:24:16.719961 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-5e664e01-a9da-489e-9a31-46827324d057 tempest-VolumesGetTestJSON-88464437 tempest-VolumesGetTestJSON-88464437-project] Returning 404 to user: Volume 5487896e-ddef-47db-b2d2-810f36ead7c7 could not be found. {{(pid=114106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:24:16.720981 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-5e664e01-a9da-489e-9a31-46827324d057 tempest-VolumesGetTestJSON-88464437 tempest-VolumesGetTestJSON-88464437-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/5487896e-ddef-47db-b2d2-810f36ead7c7" status: 404 len: 109 microversion: 2.1 time: 0.061510 Oct 19 08:24:16.722053 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 14/34] 10.222.0.26 () {58 vars in 1244 bytes} [Tue Oct 19 08:24:16 2021] GET /compute/v2.1/os-volumes/5487896e-ddef-47db-b2d2-810f36ead7c7 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:24:16.730019 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-4c5a883f-43ae-4505-bec7-5e93f31b80d8 tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] Calling method '.version_select at 0x7fcadf949670>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:16.775912 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-b214f834-ef5f-446c-a830-6bb5cfb33cb1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Getting quotas for project 6ffc881ce1324822826aec5e72a754b4. Resources: {'key_pairs'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:24:16.795653 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-4c5a883f-43ae-4505-bec7-5e93f31b80d8 tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/979b19aa-e37e-405a-b5df-3b9a1b8a1f36" status: 200 len: 288 microversion: 2.1 time: 0.069109 Oct 19 08:24:16.796208 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-b214f834-ef5f-446c-a830-6bb5cfb33cb1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Getting quotas for user 3ba4c5d03e21424eb9b326bddefbf34a and project 6ffc881ce1324822826aec5e72a754b4. Resources: {'key_pairs'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:24:16.796730 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 15/35] 10.222.0.26 () {58 vars in 1250 bytes} [Tue Oct 19 08:24:16 2021] GET /compute/v2.1/os-snapshots/979b19aa-e37e-405a-b5df-3b9a1b8a1f36 => generated 288 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:24:16.801467 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-0d441c76-4a47-4bd0-8ecb-a34df39fb26a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:16.802722 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-0d441c76-4a47-4bd0-8ecb-a34df39fb26a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:16.824102 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0d441c76-4a47-4bd0-8ecb-a34df39fb26a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:16.825671 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0d441c76-4a47-4bd0-8ecb-a34df39fb26a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:16.827499 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0d441c76-4a47-4bd0-8ecb-a34df39fb26a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:16.830473 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0d441c76-4a47-4bd0-8ecb-a34df39fb26a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:16.847310 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-b214f834-ef5f-446c-a830-6bb5cfb33cb1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.124954 Oct 19 08:24:16.855528 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 21/36] 10.222.0.26 () {62 vars in 1198 bytes} [Tue Oct 19 08:24:15 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1131 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Oct 19 08:24:16.857240 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-e5336e56-3382-4696-9846-adcf85226d47 tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] Calling method '.version_select at 0x7fcaddd9d3a0>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:16.993997 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-e5336e56-3382-4696-9846-adcf85226d47 tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/979b19aa-e37e-405a-b5df-3b9a1b8a1f36" status: 202 len: 0 microversion: 2.1 time: 0.140742 Oct 19 08:24:16.994968 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 22/37] 10.222.0.26 () {58 vars in 1253 bytes} [Tue Oct 19 08:24:16 2021] DELETE /compute/v2.1/os-snapshots/979b19aa-e37e-405a-b5df-3b9a1b8a1f36 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:24:17.003959 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-564314ce-1de7-4931-aff9-7842b1c03f2d tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] Calling method '.version_select at 0x7fcaddd72940>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:17.083852 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-564314ce-1de7-4931-aff9-7842b1c03f2d tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/979b19aa-e37e-405a-b5df-3b9a1b8a1f36" status: 200 len: 287 microversion: 2.1 time: 0.084087 Oct 19 08:24:17.084888 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 23/38] 10.222.0.26 () {58 vars in 1250 bytes} [Tue Oct 19 08:24:16 2021] GET /compute/v2.1/os-snapshots/979b19aa-e37e-405a-b5df-3b9a1b8a1f36 => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:24:17.344394 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-0d441c76-4a47-4bd0-8ecb-a34df39fb26a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:17.348281 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-0d441c76-4a47-4bd0-8ecb-a34df39fb26a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1269 microversion: 2.1 time: 0.550134 Oct 19 08:24:17.356453 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 16/39] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:16 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1269 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:17.646229 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-b353b556-481b-4abf-9f2c-4fb897d8a3b2 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:17.647269 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-b353b556-481b-4abf-9f2c-4fb897d8a3b2 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:17.658451 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b353b556-481b-4abf-9f2c-4fb897d8a3b2 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:17.658918 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b353b556-481b-4abf-9f2c-4fb897d8a3b2 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:17.660553 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b353b556-481b-4abf-9f2c-4fb897d8a3b2 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:17.663308 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b353b556-481b-4abf-9f2c-4fb897d8a3b2 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:17.850375 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-b353b556-481b-4abf-9f2c-4fb897d8a3b2 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:17.886052 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-b353b556-481b-4abf-9f2c-4fb897d8a3b2 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1272 microversion: 2.1 time: 0.243287 Oct 19 08:24:17.894751 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 24/40] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:17 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1272 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:18.097990 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-f9cc5178-1578-47fa-8b8e-f80d3a0f2820 tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] Calling method '.version_select at 0x7fcadf9498b0>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:18.139073 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.wsgi [None req-f9cc5178-1578-47fa-8b8e-f80d3a0f2820 tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] HTTP exception thrown: Snapshot 979b19aa-e37e-405a-b5df-3b9a1b8a1f36 could not be found. Oct 19 08:24:18.139938 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-f9cc5178-1578-47fa-8b8e-f80d3a0f2820 tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] Returning 404 to user: Snapshot 979b19aa-e37e-405a-b5df-3b9a1b8a1f36 could not be found. {{(pid=114106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:24:18.140944 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-f9cc5178-1578-47fa-8b8e-f80d3a0f2820 tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/979b19aa-e37e-405a-b5df-3b9a1b8a1f36" status: 404 len: 111 microversion: 2.1 time: 0.048626 Oct 19 08:24:18.142002 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 17/41] 10.222.0.26 () {58 vars in 1250 bytes} [Tue Oct 19 08:24:18 2021] GET /compute/v2.1/os-snapshots/979b19aa-e37e-405a-b5df-3b9a1b8a1f36 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:24:18.152440 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-6b14864d-ff2b-4382-b9af-df231c6209c0 tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] Calling method '.version_select at 0x7fcadd536f70>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:18.318527 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-6b14864d-ff2b-4382-b9af-df231c6209c0 tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/51957b69-c0c9-4738-8ecd-bc74683372bd" status: 202 len: 0 microversion: 2.1 time: 0.172252 Oct 19 08:24:18.319401 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 25/42] 10.222.0.26 () {58 vars in 1247 bytes} [Tue Oct 19 08:24:18 2021] DELETE /compute/v2.1/os-volumes/51957b69-c0c9-4738-8ecd-bc74683372bd => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:24:18.328527 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-31511b8b-d5d4-4649-a313-10b74cc309b5 tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] Calling method '.version_select at 0x7fcadddd7790>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:18.373431 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d72d56c5-e689-4cb7-9309-19f8153a9401 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:18.374034 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-d72d56c5-e689-4cb7-9309-19f8153a9401 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:18.395182 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d72d56c5-e689-4cb7-9309-19f8153a9401 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:18.396819 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d72d56c5-e689-4cb7-9309-19f8153a9401 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:18.398436 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d72d56c5-e689-4cb7-9309-19f8153a9401 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:18.400750 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d72d56c5-e689-4cb7-9309-19f8153a9401 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:18.589667 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-31511b8b-d5d4-4649-a313-10b74cc309b5 tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/51957b69-c0c9-4738-8ecd-bc74683372bd" status: 200 len: 344 microversion: 2.1 time: 0.265370 Oct 19 08:24:18.593142 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 18/43] 10.222.0.26 () {58 vars in 1244 bytes} [Tue Oct 19 08:24:18 2021] GET /compute/v2.1/os-volumes/51957b69-c0c9-4738-8ecd-bc74683372bd => generated 344 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:24:18.912162 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c7b1620a-e0a1-43e0-8a51-1c29bd0351c0 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:18.913671 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c7b1620a-e0a1-43e0-8a51-1c29bd0351c0 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:18.929289 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c7b1620a-e0a1-43e0-8a51-1c29bd0351c0 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:18.931176 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c7b1620a-e0a1-43e0-8a51-1c29bd0351c0 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:18.932408 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c7b1620a-e0a1-43e0-8a51-1c29bd0351c0 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:18.932891 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c7b1620a-e0a1-43e0-8a51-1c29bd0351c0 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:18.941872 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-d72d56c5-e689-4cb7-9309-19f8153a9401 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:18.950962 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-d72d56c5-e689-4cb7-9309-19f8153a9401 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1275 microversion: 2.1 time: 0.581442 Oct 19 08:24:18.954783 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 26/44] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:18 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1275 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:24:19.452339 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-c7b1620a-e0a1-43e0-8a51-1c29bd0351c0 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:19.477861 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c7b1620a-e0a1-43e0-8a51-1c29bd0351c0 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1272 microversion: 2.1 time: 0.572064 Oct 19 08:24:19.494284 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 19/45] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:18 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1272 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:19.608806 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-b5696bce-3e41-483d-b56e-b599dc7a569d tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] Calling method '.version_select at 0x7fcaddd999d0>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:19.674566 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.wsgi [None req-b5696bce-3e41-483d-b56e-b599dc7a569d tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] HTTP exception thrown: Volume 51957b69-c0c9-4738-8ecd-bc74683372bd could not be found. Oct 19 08:24:19.675110 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-b5696bce-3e41-483d-b56e-b599dc7a569d tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] Returning 404 to user: Volume 51957b69-c0c9-4738-8ecd-bc74683372bd could not be found. {{(pid=114105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:24:19.680519 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-b5696bce-3e41-483d-b56e-b599dc7a569d tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/51957b69-c0c9-4738-8ecd-bc74683372bd" status: 404 len: 109 microversion: 2.1 time: 0.079693 Oct 19 08:24:19.681291 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 27/46] 10.222.0.26 () {58 vars in 1244 bytes} [Tue Oct 19 08:24:19 2021] GET /compute/v2.1/os-volumes/51957b69-c0c9-4738-8ecd-bc74683372bd => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:24:19.697479 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-2b3cb9a2-48de-4307-aa09-a81f78717a92 tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] Calling method '.version_select at 0x7fcaddd73160>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:19.791191 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.wsgi [None req-2b3cb9a2-48de-4307-aa09-a81f78717a92 tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] HTTP exception thrown: Volume 51957b69-c0c9-4738-8ecd-bc74683372bd could not be found. Oct 19 08:24:19.791843 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-2b3cb9a2-48de-4307-aa09-a81f78717a92 tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] Returning 404 to user: Volume 51957b69-c0c9-4738-8ecd-bc74683372bd could not be found. {{(pid=114106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:24:19.792716 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-2b3cb9a2-48de-4307-aa09-a81f78717a92 tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/51957b69-c0c9-4738-8ecd-bc74683372bd" status: 404 len: 109 microversion: 2.1 time: 0.098935 Oct 19 08:24:19.793279 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 20/47] 10.222.0.26 () {58 vars in 1247 bytes} [Tue Oct 19 08:24:19 2021] DELETE /compute/v2.1/os-volumes/51957b69-c0c9-4738-8ecd-bc74683372bd => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:24:19.804459 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-66cb9f34-2d69-4ad0-a52e-ccc2c0a3628e tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] Calling method '.version_select at 0x7fcadeedd9d0>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:19.885904 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.wsgi [None req-66cb9f34-2d69-4ad0-a52e-ccc2c0a3628e tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] HTTP exception thrown: Volume 51957b69-c0c9-4738-8ecd-bc74683372bd could not be found. Oct 19 08:24:19.889686 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-66cb9f34-2d69-4ad0-a52e-ccc2c0a3628e tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] Returning 404 to user: Volume 51957b69-c0c9-4738-8ecd-bc74683372bd could not be found. {{(pid=114105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:24:19.892788 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-66cb9f34-2d69-4ad0-a52e-ccc2c0a3628e tempest-VolumesSnapshotsTestJSON-1642348782 tempest-VolumesSnapshotsTestJSON-1642348782-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/51957b69-c0c9-4738-8ecd-bc74683372bd" status: 404 len: 109 microversion: 2.1 time: 0.094486 Oct 19 08:24:19.899306 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 28/48] 10.222.0.26 () {58 vars in 1244 bytes} [Tue Oct 19 08:24:19 2021] GET /compute/v2.1/os-volumes/51957b69-c0c9-4738-8ecd-bc74683372bd => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:24:19.971178 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-6d0e51e6-b40b-4677-9797-9dd59050724a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:19.971821 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-6d0e51e6-b40b-4677-9797-9dd59050724a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:19.989439 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6d0e51e6-b40b-4677-9797-9dd59050724a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:19.989954 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6d0e51e6-b40b-4677-9797-9dd59050724a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:19.990798 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6d0e51e6-b40b-4677-9797-9dd59050724a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:19.991236 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6d0e51e6-b40b-4677-9797-9dd59050724a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:20.291820 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-6d0e51e6-b40b-4677-9797-9dd59050724a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:20.300711 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-6d0e51e6-b40b-4677-9797-9dd59050724a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1275 microversion: 2.1 time: 0.335119 Oct 19 08:24:20.305196 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 21/49] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:19 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1275 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:20.496543 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-46aad97d-3e2e-4443-aa06-0f0ff04de7a1 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:20.499012 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-46aad97d-3e2e-4443-aa06-0f0ff04de7a1 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:20.525375 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-46aad97d-3e2e-4443-aa06-0f0ff04de7a1 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:20.527617 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-46aad97d-3e2e-4443-aa06-0f0ff04de7a1 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:20.530251 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-46aad97d-3e2e-4443-aa06-0f0ff04de7a1 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:20.532818 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-46aad97d-3e2e-4443-aa06-0f0ff04de7a1 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:20.811229 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-46aad97d-3e2e-4443-aa06-0f0ff04de7a1 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:20.822016 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-46aad97d-3e2e-4443-aa06-0f0ff04de7a1 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1272 microversion: 2.1 time: 0.329222 Oct 19 08:24:20.827855 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 29/50] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:20 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1272 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:21.322856 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-7080619e-d987-418f-bbe3-df5873dda2a3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:21.323667 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-7080619e-d987-418f-bbe3-df5873dda2a3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:21.337035 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7080619e-d987-418f-bbe3-df5873dda2a3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:21.337652 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7080619e-d987-418f-bbe3-df5873dda2a3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:21.341253 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7080619e-d987-418f-bbe3-df5873dda2a3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:21.341829 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7080619e-d987-418f-bbe3-df5873dda2a3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:21.484035 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-7080619e-d987-418f-bbe3-df5873dda2a3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:21.495168 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-7080619e-d987-418f-bbe3-df5873dda2a3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1275 microversion: 2.1 time: 0.174584 Oct 19 08:24:21.505753 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 22/51] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:21 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1275 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:21.849042 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-6a8adf3e-1c3d-49ac-b446-2b122fd85807 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:21.850469 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-6a8adf3e-1c3d-49ac-b446-2b122fd85807 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:21.873871 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6a8adf3e-1c3d-49ac-b446-2b122fd85807 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:21.874628 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6a8adf3e-1c3d-49ac-b446-2b122fd85807 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:21.879364 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6a8adf3e-1c3d-49ac-b446-2b122fd85807 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:21.881296 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6a8adf3e-1c3d-49ac-b446-2b122fd85807 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:22.211792 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-3abe5e10-8fef-4390-8b97-46db255798fb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'create', calling method: .version_select at 0x7fcadd520790>, body: {"keypair": {"name": "tempest-keypair-819625590"}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:24:22.288160 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-3abe5e10-8fef-4390-8b97-46db255798fb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Getting quotas for project d039e505af3b42a3afdc9ac76295e901. Resources: {'key_pairs'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:24:22.304171 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-3abe5e10-8fef-4390-8b97-46db255798fb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Getting quotas for user 3b8dea90b58a49b391bec5f0a04acb71 and project d039e505af3b42a3afdc9ac76295e901. Resources: {'key_pairs'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:24:22.312361 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-6a8adf3e-1c3d-49ac-b446-2b122fd85807 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:22.320507 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-6a8adf3e-1c3d-49ac-b446-2b122fd85807 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1272 microversion: 2.1 time: 0.479533 Oct 19 08:24:22.321076 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 23/52] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:21 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1272 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:22.513700 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-2acce158-1531-490b-b2e5-dedbfaab432d tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:22.515267 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-2acce158-1531-490b-b2e5-dedbfaab432d tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:22.539675 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2acce158-1531-490b-b2e5-dedbfaab432d tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:22.545517 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2acce158-1531-490b-b2e5-dedbfaab432d tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:22.549966 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2acce158-1531-490b-b2e5-dedbfaab432d tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:22.554502 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2acce158-1531-490b-b2e5-dedbfaab432d tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:23.229382 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-2acce158-1531-490b-b2e5-dedbfaab432d tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:23.229743 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-3abe5e10-8fef-4390-8b97-46db255798fb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Getting quotas for project d039e505af3b42a3afdc9ac76295e901. Resources: {'key_pairs'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:24:23.247919 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-2acce158-1531-490b-b2e5-dedbfaab432d tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.736129 Oct 19 08:24:23.252870 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 24/53] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:22 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:24:23.256090 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-3abe5e10-8fef-4390-8b97-46db255798fb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Getting quotas for user 3b8dea90b58a49b391bec5f0a04acb71 and project d039e505af3b42a3afdc9ac76295e901. Resources: {'key_pairs'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:24:23.310154 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-3abe5e10-8fef-4390-8b97-46db255798fb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.479830 Oct 19 08:24:23.313733 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 30/54] 10.222.0.26 () {60 vars in 1157 bytes} [Tue Oct 19 08:24:21 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:23.339687 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-a82ce209-4e69-43d9-a377-946290d650ae tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:23.340578 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-a82ce209-4e69-43d9-a377-946290d650ae tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:23.364837 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a82ce209-4e69-43d9-a377-946290d650ae tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:23.366649 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a82ce209-4e69-43d9-a377-946290d650ae tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:23.368412 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a82ce209-4e69-43d9-a377-946290d650ae tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:23.370985 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a82ce209-4e69-43d9-a377-946290d650ae tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:23.980859 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-cdc1a07a-414f-4169-9e78-819e13318989 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-905406928", "imageRef": "9102a998-a580-4b4e-b6a1-3172273dd66d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e6374a03-ed1d-4ba6-a790-eef480dd3eea"}]}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:24:24.131938 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.network.neutron [None req-cdc1a07a-414f-4169-9e78-819e13318989 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] validate_networks() for [('e6374a03-ed1d-4ba6-a790-eef480dd3eea', None, None, None, None, None)] {{(pid=114106) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 19 08:24:24.195679 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-a82ce209-4e69-43d9-a377-946290d650ae tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:24.210709 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-a82ce209-4e69-43d9-a377-946290d650ae tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1272 microversion: 2.1 time: 0.869560 Oct 19 08:24:24.212628 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 31/55] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:23 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1272 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:24:24.268530 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2cefaacf-7e4a-4372-ba20-445b09655426 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:24.269345 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2cefaacf-7e4a-4372-ba20-445b09655426 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:24.286120 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2cefaacf-7e4a-4372-ba20-445b09655426 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:24.288515 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2cefaacf-7e4a-4372-ba20-445b09655426 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:24.295112 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2cefaacf-7e4a-4372-ba20-445b09655426 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:24.297572 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2cefaacf-7e4a-4372-ba20-445b09655426 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:25.328272 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-2cefaacf-7e4a-4372-ba20-445b09655426 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:25.340271 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2cefaacf-7e4a-4372-ba20-445b09655426 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 1.076815 Oct 19 08:24:25.342241 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 32/56] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:24 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:24:25.370153 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c555bb74-981c-4090-9808-59d11038353f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:25.372409 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-c555bb74-981c-4090-9808-59d11038353f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:25.392847 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c555bb74-981c-4090-9808-59d11038353f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:25.393715 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c555bb74-981c-4090-9808-59d11038353f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:25.396336 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c555bb74-981c-4090-9808-59d11038353f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:25.398135 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c555bb74-981c-4090-9808-59d11038353f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:26.440895 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-c555bb74-981c-4090-9808-59d11038353f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:26.451494 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-c555bb74-981c-4090-9808-59d11038353f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 1.104790 Oct 19 08:24:26.452108 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 33/57] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:25 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:26.468342 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-fc26f6f4-20ac-43d9-9bb9-f9be48e7e50e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:26.469848 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-fc26f6f4-20ac-43d9-9bb9-f9be48e7e50e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:26.492961 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fc26f6f4-20ac-43d9-9bb9-f9be48e7e50e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:26.493412 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fc26f6f4-20ac-43d9-9bb9-f9be48e7e50e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:26.494206 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fc26f6f4-20ac-43d9-9bb9-f9be48e7e50e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:26.500089 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fc26f6f4-20ac-43d9-9bb9-f9be48e7e50e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:26.771342 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-cdc1a07a-414f-4169-9e78-819e13318989 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Flavor limits 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 08:24:26.772467 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-cdc1a07a-414f-4169-9e78-819e13318989 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Image limits 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 08:24:26.773893 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-cdc1a07a-414f-4169-9e78-819e13318989 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Flavor pref 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 08:24:26.774684 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-cdc1a07a-414f-4169-9e78-819e13318989 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Image pref 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 08:24:26.775374 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-cdc1a07a-414f-4169-9e78-819e13318989 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 08:24:26.796072 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cdc1a07a-414f-4169-9e78-819e13318989 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:26.796435 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cdc1a07a-414f-4169-9e78-819e13318989 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:26.797234 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cdc1a07a-414f-4169-9e78-819e13318989 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:26.798767 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cdc1a07a-414f-4169-9e78-819e13318989 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:26.876155 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-cdc1a07a-414f-4169-9e78-819e13318989 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Getting quotas for project 656d95cbc7b3437ea618e2224cbbfeef. Resources: {'cores', 'instances', 'ram'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:24:26.897436 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-cdc1a07a-414f-4169-9e78-819e13318989 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Getting quotas for user db7431ad6d854a37a0fc5aa46eb7f29e and project 656d95cbc7b3437ea618e2224cbbfeef. Resources: {'cores', 'instances', 'ram'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:24:26.940065 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-cdc1a07a-414f-4169-9e78-819e13318989 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Going to run 1 instances... {{(pid=114106) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 19 08:24:26.942685 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-cdc1a07a-414f-4169-9e78-819e13318989 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9102a998-a580-4b4e-b6a1-3172273dd66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114106) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 19 08:24:27.114997 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-cdc1a07a-414f-4169-9e78-819e13318989 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.860829 Oct 19 08:24:27.115646 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 25/58] 10.222.0.26 () {60 vars in 1146 bytes} [Tue Oct 19 08:24:23 2021] POST /compute/v2.1/servers => generated 383 bytes in 3862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 08:24:27.135175 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ff519a14-e749-48fc-909f-7d0e1c3e6e9f tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:27.137467 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ff519a14-e749-48fc-909f-7d0e1c3e6e9f tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:27.154264 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-fc26f6f4-20ac-43d9-9bb9-f9be48e7e50e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:27.167340 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-fc26f6f4-20ac-43d9-9bb9-f9be48e7e50e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.713939 Oct 19 08:24:27.186817 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 34/59] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:26 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:27.468434 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-843f586f-8831-4400-8a70-377b76d73e00 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:27.469878 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-843f586f-8831-4400-8a70-377b76d73e00 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:27.475538 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ff519a14-e749-48fc-909f-7d0e1c3e6e9f tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:27.489902 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-843f586f-8831-4400-8a70-377b76d73e00 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:27.492211 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-843f586f-8831-4400-8a70-377b76d73e00 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:27.493304 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-843f586f-8831-4400-8a70-377b76d73e00 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:27.495578 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-843f586f-8831-4400-8a70-377b76d73e00 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:27.550081 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ff519a14-e749-48fc-909f-7d0e1c3e6e9f tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1221 microversion: 2.1 time: 0.425199 Oct 19 08:24:27.550762 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 26/60] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:27 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1221 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:27.936222 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-87c3900d-7053-44ff-8fc7-acb4743a62ab tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1428399258", "imageRef": "9102a998-a580-4b4e-b6a1-3172273dd66d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e6374a03-ed1d-4ba6-a790-eef480dd3eea"}]}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:24:28.040732 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.network.neutron [None req-87c3900d-7053-44ff-8fc7-acb4743a62ab tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] validate_networks() for [('e6374a03-ed1d-4ba6-a790-eef480dd3eea', None, None, None, None, None)] {{(pid=114106) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 19 08:24:28.538291 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-843f586f-8831-4400-8a70-377b76d73e00 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:28.550113 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-843f586f-8831-4400-8a70-377b76d73e00 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 1.085753 Oct 19 08:24:28.554888 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 35/61] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:27 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:24:28.560793 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-28d7ed20-8550-44df-b023-adb24f907ab4 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:28.561634 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-28d7ed20-8550-44df-b023-adb24f907ab4 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:28.581846 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-28d7ed20-8550-44df-b023-adb24f907ab4 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:28.583095 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-28d7ed20-8550-44df-b023-adb24f907ab4 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:28.584183 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-28d7ed20-8550-44df-b023-adb24f907ab4 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:28.584963 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-28d7ed20-8550-44df-b023-adb24f907ab4 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:28.952412 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-28d7ed20-8550-44df-b023-adb24f907ab4 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:28.970521 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-28d7ed20-8550-44df-b023-adb24f907ab4 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.406986 Oct 19 08:24:28.987155 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 36/62] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:28 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:29.511233 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-87c3900d-7053-44ff-8fc7-acb4743a62ab tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Flavor limits 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 08:24:29.511919 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-87c3900d-7053-44ff-8fc7-acb4743a62ab tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Image limits 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 08:24:29.512421 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-87c3900d-7053-44ff-8fc7-acb4743a62ab tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Flavor pref 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 08:24:29.513001 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-87c3900d-7053-44ff-8fc7-acb4743a62ab tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Image pref 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 08:24:29.513587 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-87c3900d-7053-44ff-8fc7-acb4743a62ab tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 08:24:29.525573 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-87c3900d-7053-44ff-8fc7-acb4743a62ab tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:29.526032 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-87c3900d-7053-44ff-8fc7-acb4743a62ab tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:29.529344 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-87c3900d-7053-44ff-8fc7-acb4743a62ab tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:29.529795 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-87c3900d-7053-44ff-8fc7-acb4743a62ab tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:29.571590 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-72b5fc58-f556-4405-9b7b-625a45261177 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:29.572324 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-72b5fc58-f556-4405-9b7b-625a45261177 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:29.578254 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-87c3900d-7053-44ff-8fc7-acb4743a62ab tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Getting quotas for project 656d95cbc7b3437ea618e2224cbbfeef. Resources: {'cores', 'instances', 'ram'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:24:29.585266 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-87c3900d-7053-44ff-8fc7-acb4743a62ab tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Getting quotas for user db7431ad6d854a37a0fc5aa46eb7f29e and project 656d95cbc7b3437ea618e2224cbbfeef. Resources: {'cores', 'instances', 'ram'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:24:29.593145 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-72b5fc58-f556-4405-9b7b-625a45261177 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:29.596418 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-72b5fc58-f556-4405-9b7b-625a45261177 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:29.601225 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-72b5fc58-f556-4405-9b7b-625a45261177 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:29.602358 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-72b5fc58-f556-4405-9b7b-625a45261177 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:29.616707 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-87c3900d-7053-44ff-8fc7-acb4743a62ab tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Going to run 1 instances... {{(pid=114106) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 19 08:24:29.619407 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-87c3900d-7053-44ff-8fc7-acb4743a62ab tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9102a998-a580-4b4e-b6a1-3172273dd66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114106) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 19 08:24:29.715628 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-87c3900d-7053-44ff-8fc7-acb4743a62ab tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.780519 Oct 19 08:24:29.718617 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 27/63] 10.222.0.26 () {60 vars in 1146 bytes} [Tue Oct 19 08:24:27 2021] POST /compute/v2.1/servers => generated 383 bytes in 1787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 08:24:29.732529 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b2dd5bb6-4537-4c8d-bdc7-7a44371ea05d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:29.733153 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b2dd5bb6-4537-4c8d-bdc7-7a44371ea05d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:30.213093 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-b2dd5bb6-4537-4c8d-bdc7-7a44371ea05d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:30.220793 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b2dd5bb6-4537-4c8d-bdc7-7a44371ea05d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1222 microversion: 2.1 time: 0.496605 Oct 19 08:24:30.223221 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 28/64] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:29 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1222 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:30.585300 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-72b5fc58-f556-4405-9b7b-625a45261177 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:30.601000 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-72b5fc58-f556-4405-9b7b-625a45261177 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 1.034309 Oct 19 08:24:30.624671 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 37/65] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:29 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:24:30.639769 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-160c56f8-f7a8-4efa-ae20-317331af10fa tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:30.649177 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-160c56f8-f7a8-4efa-ae20-317331af10fa tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:30.671639 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-160c56f8-f7a8-4efa-ae20-317331af10fa tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:30.672729 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-160c56f8-f7a8-4efa-ae20-317331af10fa tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:30.673715 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-160c56f8-f7a8-4efa-ae20-317331af10fa tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:30.675260 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-160c56f8-f7a8-4efa-ae20-317331af10fa tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:30.905261 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-50ec8a61-6f11-40fd-9083-d481f46a8910 req-8d0f3a78-e79e-4383-98e3-fcbfa603be99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59dbc4e4-8c02-40ac-92be-01a7d58a97a1", "tag": "cbb46daa-64d5-4b7d-a375-36a1a97d0bb6"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:24:30.907706 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:24:30.907706 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:24:30.979393 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-50ec8a61-6f11-40fd-9083-d481f46a8910 req-8d0f3a78-e79e-4383-98e3-fcbfa603be99 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:30.981327 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-50ec8a61-6f11-40fd-9083-d481f46a8910 req-8d0f3a78-e79e-4383-98e3-fcbfa603be99 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:31.032589 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-50ec8a61-6f11-40fd-9083-d481f46a8910 req-8d0f3a78-e79e-4383-98e3-fcbfa603be99 service nova] Creating event network-changed:cbb46daa-64d5-4b7d-a375-36a1a97d0bb6 for instance 59dbc4e4-8c02-40ac-92be-01a7d58a97a1 on hv-cinder-81398 Oct 19 08:24:31.033550 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-50ec8a61-6f11-40fd-9083-d481f46a8910 req-8d0f3a78-e79e-4383-98e3-fcbfa603be99 service nova] Acquired lock "compute-rpcapi-router" {{(pid=114106) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 19 08:24:31.035297 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9ed386d0-8913-4278-9982-9d91e1c988e7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:31.039934 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9ed386d0-8913-4278-9982-9d91e1c988e7 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:31.041215 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9ed386d0-8913-4278-9982-9d91e1c988e7 None None] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:31.041825 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9ed386d0-8913-4278-9982-9d91e1c988e7 None None] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:31.055827 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.compute.rpcapi [None req-9ed386d0-8913-4278-9982-9d91e1c988e7 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 19 08:24:31.061064 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9ed386d0-8913-4278-9982-9d91e1c988e7 None None] Releasing lock "compute-rpcapi-router" {{(pid=114106) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 19 08:24:31.136056 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-9ed386d0-8913-4278-9982-9d91e1c988e7 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.911318 Oct 19 08:24:31.136992 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 29/66] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:24:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:24:31.241351 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-1c17c4ca-0549-4c8f-bea0-b50e1c170941 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:31.242979 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-1c17c4ca-0549-4c8f-bea0-b50e1c170941 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:31.265825 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1c17c4ca-0549-4c8f-bea0-b50e1c170941 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:31.281343 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1c17c4ca-0549-4c8f-bea0-b50e1c170941 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:31.284543 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1c17c4ca-0549-4c8f-bea0-b50e1c170941 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:31.287815 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1c17c4ca-0549-4c8f-bea0-b50e1c170941 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:31.665491 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-1c17c4ca-0549-4c8f-bea0-b50e1c170941 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:31.674408 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-1c17c4ca-0549-4c8f-bea0-b50e1c170941 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1226 microversion: 2.1 time: 0.437237 Oct 19 08:24:31.697576 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 30/67] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:31 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1226 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:31.703235 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e832b671-fd88-4199-bda0-7a8767b07774 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:31.714413 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e832b671-fd88-4199-bda0-7a8767b07774 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:31.739865 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e832b671-fd88-4199-bda0-7a8767b07774 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:31.750255 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e832b671-fd88-4199-bda0-7a8767b07774 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:31.757885 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e832b671-fd88-4199-bda0-7a8767b07774 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:31.758824 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e832b671-fd88-4199-bda0-7a8767b07774 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:31.950903 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-160c56f8-f7a8-4efa-ae20-317331af10fa tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:31.958879 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-160c56f8-f7a8-4efa-ae20-317331af10fa tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 1.332897 Oct 19 08:24:31.960994 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 38/68] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:30 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:32.124830 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-e832b671-fd88-4199-bda0-7a8767b07774 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:32.133574 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e832b671-fd88-4199-bda0-7a8767b07774 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.434354 Oct 19 08:24:32.139857 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 31/69] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:31 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:32.384855 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-48cfcc38-6ad8-473c-900c-0a8980a1f42d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1379550688", "imageRef": "9102a998-a580-4b4e-b6a1-3172273dd66d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b7c9676-b604-477b-a586-63579afd5719"}], "security_groups": [{"name": "tempest-securitygroup--1894106543"}], "key_name": "tempest-keypair-510185428", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:24:32.509652 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.network.neutron [None req-48cfcc38-6ad8-473c-900c-0a8980a1f42d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] validate_networks() for [('8b7c9676-b604-477b-a586-63579afd5719', None, None, None, None, None)] {{(pid=114105) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 19 08:24:32.545137 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c96ed974-5934-4cf6-b4a4-cf62faef0aa9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1453405578", "imageRef": "9102a998-a580-4b4e-b6a1-3172273dd66d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ed1909e-af6f-44e6-9da9-5c8feb78bdd0"}], "security_groups": [{"name": "tempest-securitygroup--992858662"}], "key_name": "tempest-keypair-819625590", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:24:32.701666 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.network.neutron [None req-c96ed974-5934-4cf6-b4a4-cf62faef0aa9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] validate_networks() for [('5ed1909e-af6f-44e6-9da9-5c8feb78bdd0', None, None, None, None, None)] {{(pid=114106) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 19 08:24:33.163478 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-48cfcc38-6ad8-473c-900c-0a8980a1f42d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Flavor limits 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 08:24:33.164643 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-48cfcc38-6ad8-473c-900c-0a8980a1f42d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Image limits 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 08:24:33.165200 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-48cfcc38-6ad8-473c-900c-0a8980a1f42d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Flavor pref 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 08:24:33.165780 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-48cfcc38-6ad8-473c-900c-0a8980a1f42d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Image pref 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 08:24:33.166579 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-48cfcc38-6ad8-473c-900c-0a8980a1f42d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 08:24:33.176473 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-48cfcc38-6ad8-473c-900c-0a8980a1f42d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:33.177200 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-48cfcc38-6ad8-473c-900c-0a8980a1f42d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:33.178015 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-48cfcc38-6ad8-473c-900c-0a8980a1f42d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:33.178448 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-48cfcc38-6ad8-473c-900c-0a8980a1f42d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:33.195046 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-48cfcc38-6ad8-473c-900c-0a8980a1f42d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Getting quotas for project 6ffc881ce1324822826aec5e72a754b4. Resources: {'cores', 'instances', 'ram'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:24:33.198785 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-48cfcc38-6ad8-473c-900c-0a8980a1f42d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Getting quotas for user 3ba4c5d03e21424eb9b326bddefbf34a and project 6ffc881ce1324822826aec5e72a754b4. Resources: {'cores', 'instances', 'ram'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:24:33.210396 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-48cfcc38-6ad8-473c-900c-0a8980a1f42d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Going to run 1 instances... {{(pid=114105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 19 08:24:33.212618 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-48cfcc38-6ad8-473c-900c-0a8980a1f42d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9102a998-a580-4b4e-b6a1-3172273dd66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 19 08:24:33.269616 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-48cfcc38-6ad8-473c-900c-0a8980a1f42d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.894866 Oct 19 08:24:33.270297 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 39/70] 10.222.0.26 () {62 vars in 1187 bytes} [Tue Oct 19 08:24:32 2021] POST /compute/v2.1/servers => generated 402 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 19 08:24:33.275688 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-c96ed974-5934-4cf6-b4a4-cf62faef0aa9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Flavor limits 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 08:24:33.279990 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c5e0953a-166a-48c4-93a2-795bf5246e95 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:33.282537 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-c5e0953a-166a-48c4-93a2-795bf5246e95 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:33.287314 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c5e0953a-166a-48c4-93a2-795bf5246e95 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:33.287489 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-c96ed974-5934-4cf6-b4a4-cf62faef0aa9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Image limits 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 08:24:33.287808 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c5e0953a-166a-48c4-93a2-795bf5246e95 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:33.288032 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-c96ed974-5934-4cf6-b4a4-cf62faef0aa9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Flavor pref 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 08:24:33.288586 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-c96ed974-5934-4cf6-b4a4-cf62faef0aa9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Image pref 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 08:24:33.288722 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c5e0953a-166a-48c4-93a2-795bf5246e95 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:33.289007 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-c96ed974-5934-4cf6-b4a4-cf62faef0aa9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 08:24:33.289277 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c5e0953a-166a-48c4-93a2-795bf5246e95 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:33.309274 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c96ed974-5934-4cf6-b4a4-cf62faef0aa9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:33.310574 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c96ed974-5934-4cf6-b4a4-cf62faef0aa9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:33.313118 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c96ed974-5934-4cf6-b4a4-cf62faef0aa9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:33.313719 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c96ed974-5934-4cf6-b4a4-cf62faef0aa9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:33.346740 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-c96ed974-5934-4cf6-b4a4-cf62faef0aa9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Getting quotas for project d039e505af3b42a3afdc9ac76295e901. Resources: {'cores', 'instances', 'ram'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:24:33.366559 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-c96ed974-5934-4cf6-b4a4-cf62faef0aa9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Getting quotas for user 3b8dea90b58a49b391bec5f0a04acb71 and project d039e505af3b42a3afdc9ac76295e901. Resources: {'cores', 'instances', 'ram'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:24:33.420968 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-c5e0953a-166a-48c4-93a2-795bf5246e95 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:33.429719 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-c5e0953a-166a-48c4-93a2-795bf5246e95 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1218 microversion: 2.1 time: 0.153913 Oct 19 08:24:33.432764 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c96ed974-5934-4cf6-b4a4-cf62faef0aa9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Going to run 1 instances... {{(pid=114106) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 19 08:24:33.440933 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 40/71] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:33 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1218 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:33.442936 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c96ed974-5934-4cf6-b4a4-cf62faef0aa9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9102a998-a580-4b4e-b6a1-3172273dd66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114106) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 19 08:24:33.446262 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-257bf4d5-5524-4b08-b15c-b4ef2e29ffe8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:33.447075 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-257bf4d5-5524-4b08-b15c-b4ef2e29ffe8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:33.454009 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-257bf4d5-5524-4b08-b15c-b4ef2e29ffe8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:33.454626 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-257bf4d5-5524-4b08-b15c-b4ef2e29ffe8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:33.455557 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-257bf4d5-5524-4b08-b15c-b4ef2e29ffe8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:33.456200 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-257bf4d5-5524-4b08-b15c-b4ef2e29ffe8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:33.580562 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c96ed974-5934-4cf6-b4a4-cf62faef0aa9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.040817 Oct 19 08:24:33.584183 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 32/72] 10.222.0.26 () {60 vars in 1146 bytes} [Tue Oct 19 08:24:32 2021] POST /compute/v2.1/servers => generated 401 bytes in 1045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 08:24:33.595798 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-5a04ebce-64ea-4537-b921-21d4d9d889c6 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:33.596691 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-5a04ebce-64ea-4537-b921-21d4d9d889c6 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:33.608818 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5a04ebce-64ea-4537-b921-21d4d9d889c6 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:33.609330 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5a04ebce-64ea-4537-b921-21d4d9d889c6 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:33.610348 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5a04ebce-64ea-4537-b921-21d4d9d889c6 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:33.611008 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5a04ebce-64ea-4537-b921-21d4d9d889c6 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:34.495289 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-257bf4d5-5524-4b08-b15c-b4ef2e29ffe8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:34.511508 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-257bf4d5-5524-4b08-b15c-b4ef2e29ffe8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 1.064388 Oct 19 08:24:34.512355 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 41/73] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:33 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:34.526864 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-51ef91a1-4afb-4d4e-90c5-0465ad8325e4 req-a2b855ca-bc8c-41c5-9bc1-79782671f1ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b75e6c63-1b3e-4a9c-adbc-9db31920288f", "tag": "a1452749-7697-4896-9845-e408f2432615"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:24:34.529381 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:24:34.529381 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:24:34.537806 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-5a04ebce-64ea-4537-b921-21d4d9d889c6 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:34.549166 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-5a04ebce-64ea-4537-b921-21d4d9d889c6 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.963657 Oct 19 08:24:34.551900 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 33/74] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:33 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:34.558436 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-51ef91a1-4afb-4d4e-90c5-0465ad8325e4 req-a2b855ca-bc8c-41c5-9bc1-79782671f1ae service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:34.563886 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-51ef91a1-4afb-4d4e-90c5-0465ad8325e4 req-a2b855ca-bc8c-41c5-9bc1-79782671f1ae service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:34.570852 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-234f858f-84bb-4c82-941f-ff1f7c1c3a4e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:34.571623 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-234f858f-84bb-4c82-941f-ff1f7c1c3a4e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:34.585779 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-234f858f-84bb-4c82-941f-ff1f7c1c3a4e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:34.586240 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-234f858f-84bb-4c82-941f-ff1f7c1c3a4e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:34.592945 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-234f858f-84bb-4c82-941f-ff1f7c1c3a4e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:34.593820 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-234f858f-84bb-4c82-941f-ff1f7c1c3a4e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:34.625800 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-51ef91a1-4afb-4d4e-90c5-0465ad8325e4 req-a2b855ca-bc8c-41c5-9bc1-79782671f1ae service nova] Creating event network-changed:a1452749-7697-4896-9845-e408f2432615 for instance b75e6c63-1b3e-4a9c-adbc-9db31920288f on hv-cinder-81398 Oct 19 08:24:34.626587 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-51ef91a1-4afb-4d4e-90c5-0465ad8325e4 req-a2b855ca-bc8c-41c5-9bc1-79782671f1ae service nova] Acquired lock "compute-rpcapi-router" {{(pid=114105) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 19 08:24:34.628211 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-77a12b92-42a0-41d5-9e6b-85a84917a2da None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:34.628820 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-77a12b92-42a0-41d5-9e6b-85a84917a2da None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:34.629767 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-77a12b92-42a0-41d5-9e6b-85a84917a2da None None] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:34.633100 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-77a12b92-42a0-41d5-9e6b-85a84917a2da None None] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:34.659161 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.compute.rpcapi [None req-77a12b92-42a0-41d5-9e6b-85a84917a2da None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 19 08:24:34.660441 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-77a12b92-42a0-41d5-9e6b-85a84917a2da None None] Releasing lock "compute-rpcapi-router" {{(pid=114105) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 19 08:24:34.710213 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-77a12b92-42a0-41d5-9e6b-85a84917a2da None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186770 Oct 19 08:24:34.711498 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 42/75] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:24:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:24:34.721607 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c4923f35-4ecb-4081-a38d-c0ccf29a494b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:34.722919 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-c4923f35-4ecb-4081-a38d-c0ccf29a494b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:34.742221 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c4923f35-4ecb-4081-a38d-c0ccf29a494b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:34.746952 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c4923f35-4ecb-4081-a38d-c0ccf29a494b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:34.748982 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c4923f35-4ecb-4081-a38d-c0ccf29a494b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:34.749588 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c4923f35-4ecb-4081-a38d-c0ccf29a494b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:34.896960 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-234f858f-84bb-4c82-941f-ff1f7c1c3a4e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:34.907302 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-234f858f-84bb-4c82-941f-ff1f7c1c3a4e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:34.913790 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-234f858f-84bb-4c82-941f-ff1f7c1c3a4e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:34.915154 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-234f858f-84bb-4c82-941f-ff1f7c1c3a4e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1285 microversion: 2.20 time: 0.362142 Oct 19 08:24:34.915873 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 34/76] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:24:34 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1285 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:24:34.929938 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-bc687378-0e2d-49be-b4ea-3ca0458773f2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:34.931038 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-bc687378-0e2d-49be-b4ea-3ca0458773f2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:34.940548 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-c4923f35-4ecb-4081-a38d-c0ccf29a494b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:34.949997 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-c4923f35-4ecb-4081-a38d-c0ccf29a494b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1233 microversion: 2.1 time: 0.234212 Oct 19 08:24:34.953147 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 43/77] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:34 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1233 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:34.953813 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bc687378-0e2d-49be-b4ea-3ca0458773f2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:34.958617 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bc687378-0e2d-49be-b4ea-3ca0458773f2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:34.959640 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bc687378-0e2d-49be-b4ea-3ca0458773f2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:34.960282 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bc687378-0e2d-49be-b4ea-3ca0458773f2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:35.046851 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-bc687378-0e2d-49be-b4ea-3ca0458773f2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:35.058106 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-bc687378-0e2d-49be-b4ea-3ca0458773f2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1280 microversion: 2.1 time: 0.140354 Oct 19 08:24:35.060545 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 35/78] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:34 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1280 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:35.529470 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-69365707-17df-433e-829f-adbb30405a19 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:35.532887 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-69365707-17df-433e-829f-adbb30405a19 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:35.540744 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-69365707-17df-433e-829f-adbb30405a19 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:35.541185 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-69365707-17df-433e-829f-adbb30405a19 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:35.541956 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-69365707-17df-433e-829f-adbb30405a19 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:35.545396 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-69365707-17df-433e-829f-adbb30405a19 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:35.566527 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3ee1f37d-c69f-460a-9711-d55d38afa73f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:35.567780 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3ee1f37d-c69f-460a-9711-d55d38afa73f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:35.583873 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3ee1f37d-c69f-460a-9711-d55d38afa73f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:35.584319 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3ee1f37d-c69f-460a-9711-d55d38afa73f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:35.585093 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3ee1f37d-c69f-460a-9711-d55d38afa73f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:35.585542 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3ee1f37d-c69f-460a-9711-d55d38afa73f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:36.433875 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-69365707-17df-433e-829f-adbb30405a19 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:36.444233 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3ee1f37d-c69f-460a-9711-d55d38afa73f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:36.447956 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-69365707-17df-433e-829f-adbb30405a19 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.922667 Oct 19 08:24:36.452455 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3ee1f37d-c69f-460a-9711-d55d38afa73f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.889363 Oct 19 08:24:36.455139 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 36/79] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:35 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:24:36.458582 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 44/80] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:35 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:36.464836 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-9143076b-c0ba-4223-9e3c-0c01da8ef12a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:36.471301 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-9143076b-c0ba-4223-9e3c-0c01da8ef12a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:36.471477 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-24fb1b13-c9d3-4e6e-9676-f8001dbf5f8a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:36.472094 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-24fb1b13-c9d3-4e6e-9676-f8001dbf5f8a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:36.478301 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-24fb1b13-c9d3-4e6e-9676-f8001dbf5f8a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:36.479105 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-24fb1b13-c9d3-4e6e-9676-f8001dbf5f8a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:36.480095 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-24fb1b13-c9d3-4e6e-9676-f8001dbf5f8a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:36.481197 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-24fb1b13-c9d3-4e6e-9676-f8001dbf5f8a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:36.483113 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9143076b-c0ba-4223-9e3c-0c01da8ef12a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:36.483744 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9143076b-c0ba-4223-9e3c-0c01da8ef12a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:36.484716 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9143076b-c0ba-4223-9e3c-0c01da8ef12a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:36.485942 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9143076b-c0ba-4223-9e3c-0c01da8ef12a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:36.574163 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-24fb1b13-c9d3-4e6e-9676-f8001dbf5f8a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:36.586841 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-24fb1b13-c9d3-4e6e-9676-f8001dbf5f8a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1295 microversion: 2.1 time: 0.125232 Oct 19 08:24:36.588174 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 45/81] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:36 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1295 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:36.603585 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-e79afa7b-9730-4adf-9ead-6cd04554ea81 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:36.604481 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-e79afa7b-9730-4adf-9ead-6cd04554ea81 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:36.619078 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e79afa7b-9730-4adf-9ead-6cd04554ea81 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:36.619774 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e79afa7b-9730-4adf-9ead-6cd04554ea81 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:36.623113 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e79afa7b-9730-4adf-9ead-6cd04554ea81 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:36.623728 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e79afa7b-9730-4adf-9ead-6cd04554ea81 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:36.688324 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-9143076b-c0ba-4223-9e3c-0c01da8ef12a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:36.697349 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-9143076b-c0ba-4223-9e3c-0c01da8ef12a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:36.714688 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-9143076b-c0ba-4223-9e3c-0c01da8ef12a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:36.716086 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-9143076b-c0ba-4223-9e3c-0c01da8ef12a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1339 microversion: 2.20 time: 0.258011 Oct 19 08:24:36.717060 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 37/82] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:24:36 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1339 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:24:36.917433 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-e79afa7b-9730-4adf-9ead-6cd04554ea81 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:36.928572 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-e79afa7b-9730-4adf-9ead-6cd04554ea81 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1280 microversion: 2.1 time: 0.338546 Oct 19 08:24:36.929501 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 46/83] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:36 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1280 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:37.467539 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-69ad5e28-108e-44e4-88c1-5f7c2162afab tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:37.468547 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-69ad5e28-108e-44e4-88c1-5f7c2162afab tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:37.475519 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-b8d2db63-7c13-42ff-9058-88c94c50afeb tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:37.476431 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-b8d2db63-7c13-42ff-9058-88c94c50afeb tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:37.484398 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b8d2db63-7c13-42ff-9058-88c94c50afeb tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:37.487124 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b8d2db63-7c13-42ff-9058-88c94c50afeb tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:37.489015 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-69ad5e28-108e-44e4-88c1-5f7c2162afab tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:37.489699 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-69ad5e28-108e-44e4-88c1-5f7c2162afab tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:37.490834 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b8d2db63-7c13-42ff-9058-88c94c50afeb tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:37.491904 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-69ad5e28-108e-44e4-88c1-5f7c2162afab tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:37.492544 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-69ad5e28-108e-44e4-88c1-5f7c2162afab tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:37.493229 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b8d2db63-7c13-42ff-9058-88c94c50afeb tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:38.065346 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-69ad5e28-108e-44e4-88c1-5f7c2162afab tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:38.078914 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-69ad5e28-108e-44e4-88c1-5f7c2162afab tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.614597 Oct 19 08:24:38.080973 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 38/84] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:37 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:38.092026 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e3f3ef6d-16a1-432e-aed9-d88043cdcbaa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:38.092835 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e3f3ef6d-16a1-432e-aed9-d88043cdcbaa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:38.113905 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-b8d2db63-7c13-42ff-9058-88c94c50afeb tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:38.124967 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-b8d2db63-7c13-42ff-9058-88c94c50afeb tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.652166 Oct 19 08:24:38.125781 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e3f3ef6d-16a1-432e-aed9-d88043cdcbaa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:38.127044 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e3f3ef6d-16a1-432e-aed9-d88043cdcbaa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:38.129036 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 47/85] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:37 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:38.130107 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e3f3ef6d-16a1-432e-aed9-d88043cdcbaa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:38.132385 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e3f3ef6d-16a1-432e-aed9-d88043cdcbaa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:38.154112 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-541bad24-15f7-4a61-819a-bd5d54567edf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:38.155028 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-541bad24-15f7-4a61-819a-bd5d54567edf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:38.174792 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-541bad24-15f7-4a61-819a-bd5d54567edf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:38.175577 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-541bad24-15f7-4a61-819a-bd5d54567edf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:38.176802 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-541bad24-15f7-4a61-819a-bd5d54567edf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:38.177438 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-541bad24-15f7-4a61-819a-bd5d54567edf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:38.385184 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-e3f3ef6d-16a1-432e-aed9-d88043cdcbaa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:38.395329 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e3f3ef6d-16a1-432e-aed9-d88043cdcbaa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1295 microversion: 2.1 time: 0.313149 Oct 19 08:24:38.422609 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 39/86] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:38 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1295 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:38.422609 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-7d21a47b-d162-4287-8640-5b393e705bc3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:38.422609 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-7d21a47b-d162-4287-8640-5b393e705bc3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:38.430938 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7d21a47b-d162-4287-8640-5b393e705bc3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:38.431510 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7d21a47b-d162-4287-8640-5b393e705bc3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:38.432472 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7d21a47b-d162-4287-8640-5b393e705bc3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:38.433008 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7d21a47b-d162-4287-8640-5b393e705bc3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:38.657582 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-541bad24-15f7-4a61-819a-bd5d54567edf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:38.673195 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-541bad24-15f7-4a61-819a-bd5d54567edf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:38.675572 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-541bad24-15f7-4a61-819a-bd5d54567edf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:38.677827 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-541bad24-15f7-4a61-819a-bd5d54567edf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.545432 Oct 19 08:24:38.678767 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 48/87] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:24:38 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:24:39.099135 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-7d21a47b-d162-4287-8640-5b393e705bc3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:39.099621 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-999122bd-ce95-4f6b-9454-8a84baa132f8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:39.100270 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-999122bd-ce95-4f6b-9454-8a84baa132f8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:39.106393 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-7d21a47b-d162-4287-8640-5b393e705bc3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.691650 Oct 19 08:24:39.116313 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 40/88] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:38 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:39.120563 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-999122bd-ce95-4f6b-9454-8a84baa132f8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:39.121025 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-999122bd-ce95-4f6b-9454-8a84baa132f8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:39.121958 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-999122bd-ce95-4f6b-9454-8a84baa132f8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:39.124031 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-999122bd-ce95-4f6b-9454-8a84baa132f8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:39.149471 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-23f622d8-d86d-4e5a-b8a3-decc950b6be4 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:39.150079 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-23f622d8-d86d-4e5a-b8a3-decc950b6be4 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:39.160828 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-23f622d8-d86d-4e5a-b8a3-decc950b6be4 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:39.161277 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-23f622d8-d86d-4e5a-b8a3-decc950b6be4 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:39.162059 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-23f622d8-d86d-4e5a-b8a3-decc950b6be4 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:39.162546 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-23f622d8-d86d-4e5a-b8a3-decc950b6be4 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:39.762171 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-999122bd-ce95-4f6b-9454-8a84baa132f8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:39.772139 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-999122bd-ce95-4f6b-9454-8a84baa132f8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.679184 Oct 19 08:24:39.772800 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 49/89] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:39 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:24:39.787524 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-bfc2b60e-3aaf-47ab-a5ac-27bff8004c7d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:39.788207 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-bfc2b60e-3aaf-47ab-a5ac-27bff8004c7d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:39.802031 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bfc2b60e-3aaf-47ab-a5ac-27bff8004c7d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:39.802848 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bfc2b60e-3aaf-47ab-a5ac-27bff8004c7d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:39.804078 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bfc2b60e-3aaf-47ab-a5ac-27bff8004c7d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:39.804794 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bfc2b60e-3aaf-47ab-a5ac-27bff8004c7d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:39.818130 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-23f622d8-d86d-4e5a-b8a3-decc950b6be4 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:39.833984 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-23f622d8-d86d-4e5a-b8a3-decc950b6be4 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.688038 Oct 19 08:24:39.835250 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 41/90] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:39 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:24:39.917703 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-ccae2f85-3b98-4990-9d33-062c224a9559 req-02b99364-be3f-4982-9d36-8ba7e073e4bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2a856f6-f552-461f-8d9c-4bf017cbbac5", "tag": "f6a1d3b0-9ba8-4cd7-b18a-cd9b4d0b1082"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:24:39.919849 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:24:39.919849 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:24:39.932482 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-ccae2f85-3b98-4990-9d33-062c224a9559 req-02b99364-be3f-4982-9d36-8ba7e073e4bd service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:39.933024 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-ccae2f85-3b98-4990-9d33-062c224a9559 req-02b99364-be3f-4982-9d36-8ba7e073e4bd service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:39.952173 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-ccae2f85-3b98-4990-9d33-062c224a9559 req-02b99364-be3f-4982-9d36-8ba7e073e4bd service nova] Creating event network-changed:f6a1d3b0-9ba8-4cd7-b18a-cd9b4d0b1082 for instance a2a856f6-f552-461f-8d9c-4bf017cbbac5 on hv-cinder-81398 Oct 19 08:24:39.963729 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-ccae2f85-3b98-4990-9d33-062c224a9559 req-02b99364-be3f-4982-9d36-8ba7e073e4bd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126990 Oct 19 08:24:39.965000 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 42/91] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:24:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:24:39.971233 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-fe76e5f1-59d5-497c-bdb8-d423ce0a57c9 req-5875bbd4-bb9e-47a3-97ef-ef5852bf6642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feb56f1c-831c-4725-b502-fbf7f6b9fe5b", "tag": "af354896-e292-4dc8-8c66-71861bbc0358"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:24:39.973736 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:24:39.973736 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:24:39.984322 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-fe76e5f1-59d5-497c-bdb8-d423ce0a57c9 req-5875bbd4-bb9e-47a3-97ef-ef5852bf6642 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:39.984794 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-fe76e5f1-59d5-497c-bdb8-d423ce0a57c9 req-5875bbd4-bb9e-47a3-97ef-ef5852bf6642 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:40.000985 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-fe76e5f1-59d5-497c-bdb8-d423ce0a57c9 req-5875bbd4-bb9e-47a3-97ef-ef5852bf6642 service nova] Creating event network-changed:af354896-e292-4dc8-8c66-71861bbc0358 for instance feb56f1c-831c-4725-b502-fbf7f6b9fe5b on hv-cinder-81398 Oct 19 08:24:40.005900 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-fe76e5f1-59d5-497c-bdb8-d423ce0a57c9 req-5875bbd4-bb9e-47a3-97ef-ef5852bf6642 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038872 Oct 19 08:24:40.007247 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 43/92] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:24:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:24:40.013973 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-30d67d6d-fb02-4211-8c49-1401a415c218 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:40.024275 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-bfc2b60e-3aaf-47ab-a5ac-27bff8004c7d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:40.031103 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-30d67d6d-fb02-4211-8c49-1401a415c218 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:40.038042 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-bfc2b60e-3aaf-47ab-a5ac-27bff8004c7d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.254106 Oct 19 08:24:40.038583 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-30d67d6d-fb02-4211-8c49-1401a415c218 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:40.039246 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-30d67d6d-fb02-4211-8c49-1401a415c218 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:40.040608 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-30d67d6d-fb02-4211-8c49-1401a415c218 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:40.041369 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-30d67d6d-fb02-4211-8c49-1401a415c218 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:40.049565 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 50/93] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:39 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:40.127222 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-e00e8357-671d-4747-94ca-4394ec436fdd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:40.128802 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-e00e8357-671d-4747-94ca-4394ec436fdd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:40.136156 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e00e8357-671d-4747-94ca-4394ec436fdd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:40.136603 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e00e8357-671d-4747-94ca-4394ec436fdd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:40.137380 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e00e8357-671d-4747-94ca-4394ec436fdd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:40.138261 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e00e8357-671d-4747-94ca-4394ec436fdd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:40.359030 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-30d67d6d-fb02-4211-8c49-1401a415c218 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:40.369804 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-30d67d6d-fb02-4211-8c49-1401a415c218 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:40.371669 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-30d67d6d-fb02-4211-8c49-1401a415c218 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:40.378326 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-30d67d6d-fb02-4211-8c49-1401a415c218 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.364379 Oct 19 08:24:40.390222 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 44/94] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:24:40 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:24:40.431105 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-e00e8357-671d-4747-94ca-4394ec436fdd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:40.441944 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-e00e8357-671d-4747-94ca-4394ec436fdd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.319464 Oct 19 08:24:40.442581 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 51/95] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:40 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:40.801060 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a706e607-610a-48e1-bcff-310dccf98a2b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:40.801772 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a706e607-610a-48e1-bcff-310dccf98a2b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:40.811425 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a706e607-610a-48e1-bcff-310dccf98a2b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:40.811961 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a706e607-610a-48e1-bcff-310dccf98a2b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:40.817202 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a706e607-610a-48e1-bcff-310dccf98a2b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:40.817764 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a706e607-610a-48e1-bcff-310dccf98a2b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:40.851989 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-6b07cd21-e8bb-4728-9882-dc9521c96a56 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:40.852861 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-6b07cd21-e8bb-4728-9882-dc9521c96a56 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:40.868056 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b07cd21-e8bb-4728-9882-dc9521c96a56 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:40.868502 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b07cd21-e8bb-4728-9882-dc9521c96a56 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:40.869355 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b07cd21-e8bb-4728-9882-dc9521c96a56 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:40.869780 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b07cd21-e8bb-4728-9882-dc9521c96a56 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:41.068405 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a706e607-610a-48e1-bcff-310dccf98a2b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:41.072293 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-6b07cd21-e8bb-4728-9882-dc9521c96a56 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:41.081726 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-6b07cd21-e8bb-4728-9882-dc9521c96a56 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.234054 Oct 19 08:24:41.091777 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 52/96] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:40 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:24:41.092151 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a706e607-610a-48e1-bcff-310dccf98a2b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.298071 Oct 19 08:24:41.092237 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-1f4e2718-6bb2-4e94-8e0e-7298c82ac820 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:41.092237 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-1f4e2718-6bb2-4e94-8e0e-7298c82ac820 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:41.094953 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1f4e2718-6bb2-4e94-8e0e-7298c82ac820 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:41.095397 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1f4e2718-6bb2-4e94-8e0e-7298c82ac820 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:41.095510 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 45/97] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:40 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:41.096187 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1f4e2718-6bb2-4e94-8e0e-7298c82ac820 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:41.096611 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1f4e2718-6bb2-4e94-8e0e-7298c82ac820 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:41.231009 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-1f4e2718-6bb2-4e94-8e0e-7298c82ac820 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:41.240158 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-1f4e2718-6bb2-4e94-8e0e-7298c82ac820 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.156242 Oct 19 08:24:41.240765 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 53/98] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:41 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:41.396679 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b4b97329-81a7-458f-830b-739f3fac90f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:41.397288 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b4b97329-81a7-458f-830b-739f3fac90f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:41.403225 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b4b97329-81a7-458f-830b-739f3fac90f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:41.404365 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b4b97329-81a7-458f-830b-739f3fac90f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:41.405338 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b4b97329-81a7-458f-830b-739f3fac90f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:41.405978 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b4b97329-81a7-458f-830b-739f3fac90f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:41.458936 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-5559a55f-9db0-4fb0-badf-0480e7af9db6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:41.459531 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-5559a55f-9db0-4fb0-badf-0480e7af9db6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:41.469193 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5559a55f-9db0-4fb0-badf-0480e7af9db6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:41.469644 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5559a55f-9db0-4fb0-badf-0480e7af9db6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:41.471062 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5559a55f-9db0-4fb0-badf-0480e7af9db6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:41.472113 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5559a55f-9db0-4fb0-badf-0480e7af9db6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:41.581755 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-b4b97329-81a7-458f-830b-739f3fac90f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:41.589610 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-b4b97329-81a7-458f-830b-739f3fac90f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:41.591841 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-b4b97329-81a7-458f-830b-739f3fac90f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:41.593083 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b4b97329-81a7-458f-830b-739f3fac90f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.200036 Oct 19 08:24:41.593822 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 46/99] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:24:41 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:24:41.664130 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-5559a55f-9db0-4fb0-badf-0480e7af9db6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:41.673080 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-5559a55f-9db0-4fb0-badf-0480e7af9db6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.217554 Oct 19 08:24:41.674030 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 54/100] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:41 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:24:41.984995 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-4415dd91-6bfe-417e-b1ae-16bde8b9823a req-d7da83db-e412-41c6-97ce-ed3afbffa7b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30b1ba9b-8d31-4658-9d03-3be46d4f7504", "tag": "dd3a33e9-9f8d-4c39-a3b8-617d066c9a63"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:24:41.986538 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:24:41.986538 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:24:41.993765 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-4415dd91-6bfe-417e-b1ae-16bde8b9823a req-d7da83db-e412-41c6-97ce-ed3afbffa7b6 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:41.994208 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-4415dd91-6bfe-417e-b1ae-16bde8b9823a req-d7da83db-e412-41c6-97ce-ed3afbffa7b6 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:42.006772 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-4415dd91-6bfe-417e-b1ae-16bde8b9823a req-d7da83db-e412-41c6-97ce-ed3afbffa7b6 service nova] Creating event network-changed:dd3a33e9-9f8d-4c39-a3b8-617d066c9a63 for instance 30b1ba9b-8d31-4658-9d03-3be46d4f7504 on hv-cinder-81398 Oct 19 08:24:42.011609 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-4415dd91-6bfe-417e-b1ae-16bde8b9823a req-d7da83db-e412-41c6-97ce-ed3afbffa7b6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030671 Oct 19 08:24:42.012345 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 47/101] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:24:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:24:42.026356 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-855f36dd-e033-4f34-8e58-e7f0fb2802eb req-e7236904-e750-4bc5-9b98-36dea44c4ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe7dae80-4592-45ea-a52d-05aa559c102a", "tag": "3ccfabb1-82b3-4904-a943-c29622e0b546"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:24:42.027951 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:24:42.027951 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:24:42.035181 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-855f36dd-e033-4f34-8e58-e7f0fb2802eb req-e7236904-e750-4bc5-9b98-36dea44c4ac2 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:42.035737 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-855f36dd-e033-4f34-8e58-e7f0fb2802eb req-e7236904-e750-4bc5-9b98-36dea44c4ac2 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:42.047874 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-855f36dd-e033-4f34-8e58-e7f0fb2802eb req-e7236904-e750-4bc5-9b98-36dea44c4ac2 service nova] Creating event network-changed:3ccfabb1-82b3-4904-a943-c29622e0b546 for instance fe7dae80-4592-45ea-a52d-05aa559c102a on hv-cinder-81398 Oct 19 08:24:42.052971 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-855f36dd-e033-4f34-8e58-e7f0fb2802eb req-e7236904-e750-4bc5-9b98-36dea44c4ac2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030148 Oct 19 08:24:42.053438 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 55/102] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:24:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:24:42.102053 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a205bc27-9bcd-4349-8459-94244957f4ed tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:42.102991 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-bc423a1c-e577-4fe0-98be-94f11b14343d tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:42.103106 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a205bc27-9bcd-4349-8459-94244957f4ed tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:42.103693 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-bc423a1c-e577-4fe0-98be-94f11b14343d tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:42.110220 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a205bc27-9bcd-4349-8459-94244957f4ed tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:42.110690 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a205bc27-9bcd-4349-8459-94244957f4ed tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:42.111454 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a205bc27-9bcd-4349-8459-94244957f4ed tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:42.111884 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a205bc27-9bcd-4349-8459-94244957f4ed tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:42.112010 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bc423a1c-e577-4fe0-98be-94f11b14343d tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:42.112572 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bc423a1c-e577-4fe0-98be-94f11b14343d tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:42.113341 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bc423a1c-e577-4fe0-98be-94f11b14343d tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:42.113873 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bc423a1c-e577-4fe0-98be-94f11b14343d tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:42.314467 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a205bc27-9bcd-4349-8459-94244957f4ed tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:42.322446 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a205bc27-9bcd-4349-8459-94244957f4ed tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.224727 Oct 19 08:24:42.332562 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 48/103] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:42 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:42.335420 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3f38ff42-8b91-4258-94a6-7259b37650c2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:42.336027 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3f38ff42-8b91-4258-94a6-7259b37650c2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:42.336665 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-bc423a1c-e577-4fe0-98be-94f11b14343d tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:42.345661 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-bc423a1c-e577-4fe0-98be-94f11b14343d tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.246994 Oct 19 08:24:42.346540 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 56/104] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:42 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:42.352209 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3f38ff42-8b91-4258-94a6-7259b37650c2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:42.352747 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3f38ff42-8b91-4258-94a6-7259b37650c2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:42.353617 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3f38ff42-8b91-4258-94a6-7259b37650c2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:42.354210 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3f38ff42-8b91-4258-94a6-7259b37650c2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:42.485197 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3f38ff42-8b91-4258-94a6-7259b37650c2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:42.492325 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3f38ff42-8b91-4258-94a6-7259b37650c2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.163906 Oct 19 08:24:42.492888 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 49/105] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:42 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:42.611571 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-5e16192b-6ad0-4bea-8a0f-874b51bc6ec7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:42.612301 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-5e16192b-6ad0-4bea-8a0f-874b51bc6ec7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:42.618579 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5e16192b-6ad0-4bea-8a0f-874b51bc6ec7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:42.619023 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5e16192b-6ad0-4bea-8a0f-874b51bc6ec7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:42.619778 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5e16192b-6ad0-4bea-8a0f-874b51bc6ec7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:42.620200 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5e16192b-6ad0-4bea-8a0f-874b51bc6ec7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:42.692624 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ad40527b-cca3-4540-a76d-b89afcbc2f04 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:42.693453 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ad40527b-cca3-4540-a76d-b89afcbc2f04 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:42.700990 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ad40527b-cca3-4540-a76d-b89afcbc2f04 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:42.701662 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ad40527b-cca3-4540-a76d-b89afcbc2f04 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:42.702426 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ad40527b-cca3-4540-a76d-b89afcbc2f04 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:42.703024 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ad40527b-cca3-4540-a76d-b89afcbc2f04 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:42.784807 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-5e16192b-6ad0-4bea-8a0f-874b51bc6ec7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:42.794504 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-5e16192b-6ad0-4bea-8a0f-874b51bc6ec7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:42.796455 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-5e16192b-6ad0-4bea-8a0f-874b51bc6ec7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:42.798122 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-5e16192b-6ad0-4bea-8a0f-874b51bc6ec7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.190203 Oct 19 08:24:42.799419 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 57/106] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:24:42 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:24:42.863173 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ad40527b-cca3-4540-a76d-b89afcbc2f04 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:42.864699 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ad40527b-cca3-4540-a76d-b89afcbc2f04 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.178172 Oct 19 08:24:42.865726 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 50/107] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:42 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:43.338547 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8fa9fc67-8895-4104-938e-5cf9910bf879 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:43.339142 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-8fa9fc67-8895-4104-938e-5cf9910bf879 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:43.345003 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8fa9fc67-8895-4104-938e-5cf9910bf879 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:43.345436 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8fa9fc67-8895-4104-938e-5cf9910bf879 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:43.346178 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8fa9fc67-8895-4104-938e-5cf9910bf879 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:43.346630 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8fa9fc67-8895-4104-938e-5cf9910bf879 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:43.362583 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-d4cfcca5-c726-4fac-b731-f3a403136463 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:43.363185 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-d4cfcca5-c726-4fac-b731-f3a403136463 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:43.368795 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d4cfcca5-c726-4fac-b731-f3a403136463 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:43.369236 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d4cfcca5-c726-4fac-b731-f3a403136463 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:43.369982 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d4cfcca5-c726-4fac-b731-f3a403136463 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:43.370406 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d4cfcca5-c726-4fac-b731-f3a403136463 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:43.689641 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-8fa9fc67-8895-4104-938e-5cf9910bf879 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:43.697249 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-8fa9fc67-8895-4104-938e-5cf9910bf879 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.362266 Oct 19 08:24:43.707780 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 58/108] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:43 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:43.713310 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-4777a7ad-8c50-4d8b-8a7c-90a6f9bc111a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:43.714078 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-4777a7ad-8c50-4d8b-8a7c-90a6f9bc111a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:43.721057 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4777a7ad-8c50-4d8b-8a7c-90a6f9bc111a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:43.721863 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4777a7ad-8c50-4d8b-8a7c-90a6f9bc111a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:43.722866 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4777a7ad-8c50-4d8b-8a7c-90a6f9bc111a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:43.723610 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4777a7ad-8c50-4d8b-8a7c-90a6f9bc111a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:43.738471 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-d4cfcca5-c726-4fac-b731-f3a403136463 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:43.748490 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-d4cfcca5-c726-4fac-b731-f3a403136463 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.389392 Oct 19 08:24:43.753381 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 51/109] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:43 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:24:43.816270 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-2cc0c64d-dc85-4800-a949-936d857b2bed tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:43.817120 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-2cc0c64d-dc85-4800-a949-936d857b2bed tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:43.823008 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2cc0c64d-dc85-4800-a949-936d857b2bed tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:43.823631 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2cc0c64d-dc85-4800-a949-936d857b2bed tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:43.824553 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2cc0c64d-dc85-4800-a949-936d857b2bed tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:43.825847 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2cc0c64d-dc85-4800-a949-936d857b2bed tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:44.220411 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-4777a7ad-8c50-4d8b-8a7c-90a6f9bc111a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:44.231082 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-4777a7ad-8c50-4d8b-8a7c-90a6f9bc111a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.521689 Oct 19 08:24:44.232787 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 59/110] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:43 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:44.238931 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8514e7d2-1305-452d-b554-7686ea63ec71 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:44.243699 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-2cc0c64d-dc85-4800-a949-936d857b2bed tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:44.251284 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-8514e7d2-1305-452d-b554-7686ea63ec71 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:44.264589 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8514e7d2-1305-452d-b554-7686ea63ec71 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:44.265260 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8514e7d2-1305-452d-b554-7686ea63ec71 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:44.266410 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8514e7d2-1305-452d-b554-7686ea63ec71 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:44.267255 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8514e7d2-1305-452d-b554-7686ea63ec71 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:44.274223 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-2cc0c64d-dc85-4800-a949-936d857b2bed tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:44.276769 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-2cc0c64d-dc85-4800-a949-936d857b2bed tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:44.278870 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-2cc0c64d-dc85-4800-a949-936d857b2bed tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.466000 Oct 19 08:24:44.290610 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 52/111] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:24:43 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:24:44.716269 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c26abf24-d933-457c-b307-05c28da697b8 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:44.717410 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c26abf24-d933-457c-b307-05c28da697b8 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:44.726948 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c26abf24-d933-457c-b307-05c28da697b8 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:44.727586 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c26abf24-d933-457c-b307-05c28da697b8 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:44.730073 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c26abf24-d933-457c-b307-05c28da697b8 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:44.732947 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c26abf24-d933-457c-b307-05c28da697b8 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:44.798811 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-8514e7d2-1305-452d-b554-7686ea63ec71 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:44.811156 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-8514e7d2-1305-452d-b554-7686ea63ec71 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.576760 Oct 19 08:24:44.812157 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 60/112] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:44 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:44.818060 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d0ccf51a-b538-48b7-9f5c-14a22a98b73f tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:44.823899 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-d0ccf51a-b538-48b7-9f5c-14a22a98b73f tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:44.835053 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d0ccf51a-b538-48b7-9f5c-14a22a98b73f tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:44.835854 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d0ccf51a-b538-48b7-9f5c-14a22a98b73f tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:44.836799 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d0ccf51a-b538-48b7-9f5c-14a22a98b73f tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:44.837232 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d0ccf51a-b538-48b7-9f5c-14a22a98b73f tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:45.154734 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-c26abf24-d933-457c-b307-05c28da697b8 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:45.167126 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c26abf24-d933-457c-b307-05c28da697b8 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.455219 Oct 19 08:24:45.168518 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 53/113] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:44 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:45.251405 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-f5a4b3c2-b5e4-43b1-9c60-ab5fc5bcdcde tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:45.252118 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-f5a4b3c2-b5e4-43b1-9c60-ab5fc5bcdcde tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:45.258818 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f5a4b3c2-b5e4-43b1-9c60-ab5fc5bcdcde tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:45.259962 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f5a4b3c2-b5e4-43b1-9c60-ab5fc5bcdcde tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:45.260980 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f5a4b3c2-b5e4-43b1-9c60-ab5fc5bcdcde tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:45.261425 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f5a4b3c2-b5e4-43b1-9c60-ab5fc5bcdcde tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:45.288233 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-d0ccf51a-b538-48b7-9f5c-14a22a98b73f tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:45.300127 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-d0ccf51a-b538-48b7-9f5c-14a22a98b73f tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.486573 Oct 19 08:24:45.300941 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 61/114] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:44 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:45.306123 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-68870250-de17-4a74-a23f-86a8f38ef5e3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:45.307149 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-68870250-de17-4a74-a23f-86a8f38ef5e3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:45.315487 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-68870250-de17-4a74-a23f-86a8f38ef5e3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:45.315930 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-68870250-de17-4a74-a23f-86a8f38ef5e3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:45.316688 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-68870250-de17-4a74-a23f-86a8f38ef5e3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:45.317104 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-68870250-de17-4a74-a23f-86a8f38ef5e3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:45.566861 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-f5a4b3c2-b5e4-43b1-9c60-ab5fc5bcdcde tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:45.574272 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-f5a4b3c2-b5e4-43b1-9c60-ab5fc5bcdcde tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.328738 Oct 19 08:24:45.574881 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 54/115] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:45 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:45.593975 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-68870250-de17-4a74-a23f-86a8f38ef5e3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:45.601740 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-68870250-de17-4a74-a23f-86a8f38ef5e3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:45.603268 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-68870250-de17-4a74-a23f-86a8f38ef5e3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:45.604396 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-68870250-de17-4a74-a23f-86a8f38ef5e3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.302251 Oct 19 08:24:45.604944 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 62/116] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:24:45 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:24:45.828199 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-6b6ae5cb-5322-4d38-834d-791c0940de92 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:45.828829 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-6b6ae5cb-5322-4d38-834d-791c0940de92 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:45.835888 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6b6ae5cb-5322-4d38-834d-791c0940de92 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:45.836321 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6b6ae5cb-5322-4d38-834d-791c0940de92 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:45.837067 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6b6ae5cb-5322-4d38-834d-791c0940de92 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:45.837487 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6b6ae5cb-5322-4d38-834d-791c0940de92 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:45.961634 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-6b6ae5cb-5322-4d38-834d-791c0940de92 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:45.969448 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-6b6ae5cb-5322-4d38-834d-791c0940de92 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.144887 Oct 19 08:24:45.969989 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 55/117] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:45 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:46.185826 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-75e1a524-07dc-4a91-9353-593bc1a688d8 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:46.186350 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-75e1a524-07dc-4a91-9353-593bc1a688d8 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:46.192078 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-75e1a524-07dc-4a91-9353-593bc1a688d8 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:46.192519 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-75e1a524-07dc-4a91-9353-593bc1a688d8 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:46.193271 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-75e1a524-07dc-4a91-9353-593bc1a688d8 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:46.193694 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-75e1a524-07dc-4a91-9353-593bc1a688d8 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:46.315599 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-75e1a524-07dc-4a91-9353-593bc1a688d8 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:46.316961 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-01e32508-40e1-4f6e-9f36-b59517880465 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:46.317564 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-01e32508-40e1-4f6e-9f36-b59517880465 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:46.323342 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-01e32508-40e1-4f6e-9f36-b59517880465 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:46.323774 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-01e32508-40e1-4f6e-9f36-b59517880465 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:46.324547 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-01e32508-40e1-4f6e-9f36-b59517880465 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:46.324648 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-75e1a524-07dc-4a91-9353-593bc1a688d8 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.143059 Oct 19 08:24:46.324955 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-01e32508-40e1-4f6e-9f36-b59517880465 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:46.325592 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 63/118] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:46 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:46.444478 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-01e32508-40e1-4f6e-9f36-b59517880465 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:46.451734 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-01e32508-40e1-4f6e-9f36-b59517880465 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.138499 Oct 19 08:24:46.452285 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 56/119] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:46 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:24:46.592572 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-77e5511f-4769-4e44-bd5f-fa39ea70a72b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:46.593202 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-77e5511f-4769-4e44-bd5f-fa39ea70a72b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:46.598870 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-77e5511f-4769-4e44-bd5f-fa39ea70a72b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:46.599305 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-77e5511f-4769-4e44-bd5f-fa39ea70a72b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:46.600050 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-77e5511f-4769-4e44-bd5f-fa39ea70a72b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:46.600470 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-77e5511f-4769-4e44-bd5f-fa39ea70a72b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:46.621213 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-be77ff7a-11e4-4add-a750-adbdd12d8bec tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:46.621882 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-be77ff7a-11e4-4add-a750-adbdd12d8bec tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:46.628015 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-be77ff7a-11e4-4add-a750-adbdd12d8bec tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:46.628435 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-be77ff7a-11e4-4add-a750-adbdd12d8bec tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:46.629183 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-be77ff7a-11e4-4add-a750-adbdd12d8bec tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:46.629598 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-be77ff7a-11e4-4add-a750-adbdd12d8bec tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:46.777896 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-77e5511f-4769-4e44-bd5f-fa39ea70a72b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:46.785364 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-be77ff7a-11e4-4add-a750-adbdd12d8bec tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:46.786701 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-77e5511f-4769-4e44-bd5f-fa39ea70a72b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.198490 Oct 19 08:24:46.787263 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 64/120] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:46 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:46.793431 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-be77ff7a-11e4-4add-a750-adbdd12d8bec tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:46.795541 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-be77ff7a-11e4-4add-a750-adbdd12d8bec tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:46.797180 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-be77ff7a-11e4-4add-a750-adbdd12d8bec tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.179304 Oct 19 08:24:46.797839 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 57/121] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:24:46 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:24:46.986104 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-5fddf52c-0ade-4e63-a8f2-817d855f70ca tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:46.986775 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-5fddf52c-0ade-4e63-a8f2-817d855f70ca tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:46.992376 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5fddf52c-0ade-4e63-a8f2-817d855f70ca tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:46.992914 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5fddf52c-0ade-4e63-a8f2-817d855f70ca tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:46.993642 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5fddf52c-0ade-4e63-a8f2-817d855f70ca tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:46.994031 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5fddf52c-0ade-4e63-a8f2-817d855f70ca tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:47.111223 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-5fddf52c-0ade-4e63-a8f2-817d855f70ca tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:47.118191 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-5fddf52c-0ade-4e63-a8f2-817d855f70ca tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.135859 Oct 19 08:24:47.118778 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 65/122] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:46 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:47.341051 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-5c3d0378-31c6-40b6-a9a9-ad9732ade5d4 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:47.341506 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-5c3d0378-31c6-40b6-a9a9-ad9732ade5d4 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:47.347281 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5c3d0378-31c6-40b6-a9a9-ad9732ade5d4 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:47.347723 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5c3d0378-31c6-40b6-a9a9-ad9732ade5d4 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:47.348561 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5c3d0378-31c6-40b6-a9a9-ad9732ade5d4 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:47.348888 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5c3d0378-31c6-40b6-a9a9-ad9732ade5d4 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:47.468236 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-7d310fc4-3cd0-43b8-a53a-e488d2094467 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:47.468723 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-5c3d0378-31c6-40b6-a9a9-ad9732ade5d4 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:47.468833 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-7d310fc4-3cd0-43b8-a53a-e488d2094467 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:47.474552 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7d310fc4-3cd0-43b8-a53a-e488d2094467 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:47.475080 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7d310fc4-3cd0-43b8-a53a-e488d2094467 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:47.475852 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7d310fc4-3cd0-43b8-a53a-e488d2094467 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:47.476275 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7d310fc4-3cd0-43b8-a53a-e488d2094467 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:47.479258 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-5c3d0378-31c6-40b6-a9a9-ad9732ade5d4 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.142046 Oct 19 08:24:47.480109 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 58/123] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:47 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:47.592672 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-7d310fc4-3cd0-43b8-a53a-e488d2094467 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:47.599702 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-7d310fc4-3cd0-43b8-a53a-e488d2094467 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.135255 Oct 19 08:24:47.600254 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 66/124] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:47 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:24:47.804012 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-804eae4d-c98c-4a21-abc4-5b3b3f512362 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:47.804551 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-804eae4d-c98c-4a21-abc4-5b3b3f512362 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:47.811011 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-804eae4d-c98c-4a21-abc4-5b3b3f512362 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:47.811454 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-804eae4d-c98c-4a21-abc4-5b3b3f512362 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:47.812208 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-804eae4d-c98c-4a21-abc4-5b3b3f512362 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:47.812625 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-804eae4d-c98c-4a21-abc4-5b3b3f512362 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:47.816116 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-f61b51af-6ee0-4547-9eee-edc51c3394d4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:47.816715 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-f61b51af-6ee0-4547-9eee-edc51c3394d4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:47.822286 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f61b51af-6ee0-4547-9eee-edc51c3394d4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:47.822767 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f61b51af-6ee0-4547-9eee-edc51c3394d4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:47.823518 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f61b51af-6ee0-4547-9eee-edc51c3394d4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:47.823948 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f61b51af-6ee0-4547-9eee-edc51c3394d4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:47.988221 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-804eae4d-c98c-4a21-abc4-5b3b3f512362 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:47.992692 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-f61b51af-6ee0-4547-9eee-edc51c3394d4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:47.995829 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-804eae4d-c98c-4a21-abc4-5b3b3f512362 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.195465 Oct 19 08:24:47.996391 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 59/125] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:47 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:48.000842 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-f61b51af-6ee0-4547-9eee-edc51c3394d4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:48.002458 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-f61b51af-6ee0-4547-9eee-edc51c3394d4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:48.003856 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-f61b51af-6ee0-4547-9eee-edc51c3394d4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.191330 Oct 19 08:24:48.004628 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 67/126] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:24:47 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:24:48.135315 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-7c01aa5a-8735-4f70-b39d-0cbd4b568e63 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:48.135917 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-7c01aa5a-8735-4f70-b39d-0cbd4b568e63 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:48.142321 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7c01aa5a-8735-4f70-b39d-0cbd4b568e63 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:48.142794 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7c01aa5a-8735-4f70-b39d-0cbd4b568e63 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:48.143541 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7c01aa5a-8735-4f70-b39d-0cbd4b568e63 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:48.143967 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7c01aa5a-8735-4f70-b39d-0cbd4b568e63 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:48.260790 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-7c01aa5a-8735-4f70-b39d-0cbd4b568e63 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:48.267998 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-7c01aa5a-8735-4f70-b39d-0cbd4b568e63 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.136262 Oct 19 08:24:48.268557 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 60/127] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:48 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:48.496165 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-e30c9f31-462a-47cf-8de4-3079e724c323 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:48.496923 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-e30c9f31-462a-47cf-8de4-3079e724c323 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:48.503627 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e30c9f31-462a-47cf-8de4-3079e724c323 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:48.504064 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e30c9f31-462a-47cf-8de4-3079e724c323 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:48.504817 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e30c9f31-462a-47cf-8de4-3079e724c323 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:48.505245 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e30c9f31-462a-47cf-8de4-3079e724c323 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:48.616817 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-eb34376e-c605-4bbe-aec3-379d5dc30a71 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:48.617421 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-eb34376e-c605-4bbe-aec3-379d5dc30a71 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:48.622424 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-e30c9f31-462a-47cf-8de4-3079e724c323 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:48.623203 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-eb34376e-c605-4bbe-aec3-379d5dc30a71 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:48.623648 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-eb34376e-c605-4bbe-aec3-379d5dc30a71 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:48.624434 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-eb34376e-c605-4bbe-aec3-379d5dc30a71 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:48.624849 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-eb34376e-c605-4bbe-aec3-379d5dc30a71 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:48.629890 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-e30c9f31-462a-47cf-8de4-3079e724c323 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.137320 Oct 19 08:24:48.630459 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 68/128] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:48 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:48.749544 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-eb34376e-c605-4bbe-aec3-379d5dc30a71 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:48.756896 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-eb34376e-c605-4bbe-aec3-379d5dc30a71 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.143670 Oct 19 08:24:48.757453 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 61/129] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:48 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:24:49.014565 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-827fb6b9-6828-4246-9ccc-e21f0531d9b6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:49.015087 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-827fb6b9-6828-4246-9ccc-e21f0531d9b6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:49.021313 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-827fb6b9-6828-4246-9ccc-e21f0531d9b6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:49.021759 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-827fb6b9-6828-4246-9ccc-e21f0531d9b6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:49.022267 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-1249e293-e083-4086-8d63-65dc831640bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:49.022550 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-827fb6b9-6828-4246-9ccc-e21f0531d9b6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:49.022899 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-1249e293-e083-4086-8d63-65dc831640bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:49.022994 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-827fb6b9-6828-4246-9ccc-e21f0531d9b6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:49.029232 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1249e293-e083-4086-8d63-65dc831640bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:49.029675 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1249e293-e083-4086-8d63-65dc831640bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:49.030602 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1249e293-e083-4086-8d63-65dc831640bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:49.031035 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1249e293-e083-4086-8d63-65dc831640bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:49.205864 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-827fb6b9-6828-4246-9ccc-e21f0531d9b6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:49.213317 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-1249e293-e083-4086-8d63-65dc831640bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:49.213464 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-827fb6b9-6828-4246-9ccc-e21f0531d9b6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.203155 Oct 19 08:24:49.213995 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 69/130] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:49 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:49.222009 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-1249e293-e083-4086-8d63-65dc831640bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:49.223731 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-1249e293-e083-4086-8d63-65dc831640bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:49.225276 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-1249e293-e083-4086-8d63-65dc831640bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.206488 Oct 19 08:24:49.225840 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 62/131] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:24:49 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:24:49.285387 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-48a534db-3aba-4082-9a03-7dc9c97d1eac tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:49.285900 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-48a534db-3aba-4082-9a03-7dc9c97d1eac tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:49.292027 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-48a534db-3aba-4082-9a03-7dc9c97d1eac tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:49.292459 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-48a534db-3aba-4082-9a03-7dc9c97d1eac tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:49.293241 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-48a534db-3aba-4082-9a03-7dc9c97d1eac tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:49.293687 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-48a534db-3aba-4082-9a03-7dc9c97d1eac tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:49.420131 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-48a534db-3aba-4082-9a03-7dc9c97d1eac tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:49.427377 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-48a534db-3aba-4082-9a03-7dc9c97d1eac tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.145962 Oct 19 08:24:49.427929 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 70/132] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:49 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:49.646304 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-815d5659-09b3-481f-b2ce-9598f0b4edde tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:49.646952 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-815d5659-09b3-481f-b2ce-9598f0b4edde tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:49.652696 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-815d5659-09b3-481f-b2ce-9598f0b4edde tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:49.653184 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-815d5659-09b3-481f-b2ce-9598f0b4edde tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:49.653936 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-815d5659-09b3-481f-b2ce-9598f0b4edde tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:49.654358 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-815d5659-09b3-481f-b2ce-9598f0b4edde tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:49.772643 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-815d5659-09b3-481f-b2ce-9598f0b4edde tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:49.773099 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2afb600d-2890-477b-b7f7-e8bac9b14dae tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:49.773709 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2afb600d-2890-477b-b7f7-e8bac9b14dae tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:49.779788 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2afb600d-2890-477b-b7f7-e8bac9b14dae tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:49.780233 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2afb600d-2890-477b-b7f7-e8bac9b14dae tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:49.780331 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-815d5659-09b3-481f-b2ce-9598f0b4edde tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.137576 Oct 19 08:24:49.780794 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 63/133] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:49 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:49.780993 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2afb600d-2890-477b-b7f7-e8bac9b14dae tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:49.781417 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2afb600d-2890-477b-b7f7-e8bac9b14dae tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:49.907787 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-2afb600d-2890-477b-b7f7-e8bac9b14dae tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:49.914820 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2afb600d-2890-477b-b7f7-e8bac9b14dae tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.145417 Oct 19 08:24:49.915398 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 71/134] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:49 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:24:50.230743 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-89666219-038e-4032-96e2-21ba1cc12e63 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:50.232082 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-89666219-038e-4032-96e2-21ba1cc12e63 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:50.237754 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-89666219-038e-4032-96e2-21ba1cc12e63 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:50.238180 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-89666219-038e-4032-96e2-21ba1cc12e63 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:50.238945 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-89666219-038e-4032-96e2-21ba1cc12e63 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:50.239373 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-89666219-038e-4032-96e2-21ba1cc12e63 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:50.244444 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-b70cdd82-f9be-4bd1-96b2-41bb905d6622 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:50.245037 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-b70cdd82-f9be-4bd1-96b2-41bb905d6622 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:50.250930 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b70cdd82-f9be-4bd1-96b2-41bb905d6622 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:50.251367 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b70cdd82-f9be-4bd1-96b2-41bb905d6622 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:50.252111 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b70cdd82-f9be-4bd1-96b2-41bb905d6622 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:50.252531 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b70cdd82-f9be-4bd1-96b2-41bb905d6622 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:50.415387 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-89666219-038e-4032-96e2-21ba1cc12e63 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:50.420253 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-b70cdd82-f9be-4bd1-96b2-41bb905d6622 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:50.422860 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-89666219-038e-4032-96e2-21ba1cc12e63 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.195587 Oct 19 08:24:50.423613 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 64/135] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:50 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:50.428736 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-b70cdd82-f9be-4bd1-96b2-41bb905d6622 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:50.430232 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-b70cdd82-f9be-4bd1-96b2-41bb905d6622 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:50.431417 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-b70cdd82-f9be-4bd1-96b2-41bb905d6622 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.190579 Oct 19 08:24:50.432116 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 72/136] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:24:50 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:24:50.444472 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-0c741b0d-fdf0-4e7e-8e99-54b2af803694 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:50.445069 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-0c741b0d-fdf0-4e7e-8e99-54b2af803694 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:50.452077 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0c741b0d-fdf0-4e7e-8e99-54b2af803694 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:50.452524 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0c741b0d-fdf0-4e7e-8e99-54b2af803694 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:50.453317 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0c741b0d-fdf0-4e7e-8e99-54b2af803694 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:50.453714 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0c741b0d-fdf0-4e7e-8e99-54b2af803694 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:50.578747 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-0c741b0d-fdf0-4e7e-8e99-54b2af803694 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:50.586429 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-0c741b0d-fdf0-4e7e-8e99-54b2af803694 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.145461 Oct 19 08:24:50.587178 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 65/137] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:50 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:50.796982 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-7b9c6da3-65e8-4524-abfa-c6f75d41e0cb tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:50.797624 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-7b9c6da3-65e8-4524-abfa-c6f75d41e0cb tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:50.807848 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7b9c6da3-65e8-4524-abfa-c6f75d41e0cb tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:50.808289 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7b9c6da3-65e8-4524-abfa-c6f75d41e0cb tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:50.809070 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7b9c6da3-65e8-4524-abfa-c6f75d41e0cb tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:50.809605 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7b9c6da3-65e8-4524-abfa-c6f75d41e0cb tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:50.932870 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-0f7a122c-a6fc-4179-9d41-0cd796b1ce8b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:50.933589 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-0f7a122c-a6fc-4179-9d41-0cd796b1ce8b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:50.938582 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-7b9c6da3-65e8-4524-abfa-c6f75d41e0cb tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:50.940162 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0f7a122c-a6fc-4179-9d41-0cd796b1ce8b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:50.940783 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0f7a122c-a6fc-4179-9d41-0cd796b1ce8b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:50.941697 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0f7a122c-a6fc-4179-9d41-0cd796b1ce8b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:50.942470 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0f7a122c-a6fc-4179-9d41-0cd796b1ce8b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:50.948551 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-7b9c6da3-65e8-4524-abfa-c6f75d41e0cb tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.155342 Oct 19 08:24:50.949173 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 73/138] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:50 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:24:51.071369 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-0f7a122c-a6fc-4179-9d41-0cd796b1ce8b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:51.079443 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-0f7a122c-a6fc-4179-9d41-0cd796b1ce8b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.150201 Oct 19 08:24:51.079995 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 66/139] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:50 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:51.440209 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-f409a914-b232-48e6-993c-c68aac812caf tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:51.440805 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-f409a914-b232-48e6-993c-c68aac812caf tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:51.446657 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f409a914-b232-48e6-993c-c68aac812caf tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:51.447096 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f409a914-b232-48e6-993c-c68aac812caf tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:51.447852 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f409a914-b232-48e6-993c-c68aac812caf tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:51.448273 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f409a914-b232-48e6-993c-c68aac812caf tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:51.448644 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-78fa8aa0-e59f-46e6-97c5-ed18a3a143bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:51.449236 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-78fa8aa0-e59f-46e6-97c5-ed18a3a143bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:51.455084 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-78fa8aa0-e59f-46e6-97c5-ed18a3a143bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:51.455515 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-78fa8aa0-e59f-46e6-97c5-ed18a3a143bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:51.456256 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-78fa8aa0-e59f-46e6-97c5-ed18a3a143bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:51.456673 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-78fa8aa0-e59f-46e6-97c5-ed18a3a143bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:51.629692 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-f409a914-b232-48e6-993c-c68aac812caf tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:51.632270 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-78fa8aa0-e59f-46e6-97c5-ed18a3a143bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:51.637325 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-f409a914-b232-48e6-993c-c68aac812caf tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.200742 Oct 19 08:24:51.638134 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 74/140] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:51 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:24:51.647066 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-78fa8aa0-e59f-46e6-97c5-ed18a3a143bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:51.647066 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-78fa8aa0-e59f-46e6-97c5-ed18a3a143bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:51.647066 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-78fa8aa0-e59f-46e6-97c5-ed18a3a143bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.198576 Oct 19 08:24:51.647363 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 67/141] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:24:51 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:24:51.648796 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-13d192b5-ec2b-44bd-ad92-9526c568e16c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:51.649514 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-13d192b5-ec2b-44bd-ad92-9526c568e16c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:51.655984 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-13d192b5-ec2b-44bd-ad92-9526c568e16c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:51.656524 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-13d192b5-ec2b-44bd-ad92-9526c568e16c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:51.657351 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-13d192b5-ec2b-44bd-ad92-9526c568e16c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:51.657774 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-13d192b5-ec2b-44bd-ad92-9526c568e16c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:51.777328 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-13d192b5-ec2b-44bd-ad92-9526c568e16c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:51.784731 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-13d192b5-ec2b-44bd-ad92-9526c568e16c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.139515 Oct 19 08:24:51.785299 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 68/142] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:51 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:51.964814 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-d4e90105-f114-49db-b27a-2ae5ab80897f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:51.965380 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-d4e90105-f114-49db-b27a-2ae5ab80897f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:51.971615 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d4e90105-f114-49db-b27a-2ae5ab80897f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:51.972063 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d4e90105-f114-49db-b27a-2ae5ab80897f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:51.972820 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d4e90105-f114-49db-b27a-2ae5ab80897f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:51.973245 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d4e90105-f114-49db-b27a-2ae5ab80897f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:52.013300 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-0a6c1c78-4889-499e-a920-29fb239fbe94 req-ff6795bb-f179-4451-b478-086fd7761ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59dbc4e4-8c02-40ac-92be-01a7d58a97a1", "name": "network-vif-plugged", "status": "completed", "tag": "cbb46daa-64d5-4b7d-a375-36a1a97d0bb6"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:24:52.015204 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:24:52.015204 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:24:52.021892 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-0a6c1c78-4889-499e-a920-29fb239fbe94 req-ff6795bb-f179-4451-b478-086fd7761ce9 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:52.022326 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-0a6c1c78-4889-499e-a920-29fb239fbe94 req-ff6795bb-f179-4451-b478-086fd7761ce9 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:52.032946 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-0a6c1c78-4889-499e-a920-29fb239fbe94 req-ff6795bb-f179-4451-b478-086fd7761ce9 service nova] Creating event network-vif-plugged:cbb46daa-64d5-4b7d-a375-36a1a97d0bb6 for instance 59dbc4e4-8c02-40ac-92be-01a7d58a97a1 on hv-cinder-81398 Oct 19 08:24:52.037994 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-0a6c1c78-4889-499e-a920-29fb239fbe94 req-ff6795bb-f179-4451-b478-086fd7761ce9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089882 Oct 19 08:24:52.038808 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 75/143] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:24:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:24:52.095876 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-d4e90105-f114-49db-b27a-2ae5ab80897f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:52.096223 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-09181bf7-b7af-47fa-9cf9-61b447d1dae9 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:52.096912 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-09181bf7-b7af-47fa-9cf9-61b447d1dae9 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:52.102770 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-09181bf7-b7af-47fa-9cf9-61b447d1dae9 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:52.103126 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-d4e90105-f114-49db-b27a-2ae5ab80897f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.142025 Oct 19 08:24:52.103223 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-09181bf7-b7af-47fa-9cf9-61b447d1dae9 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:52.103698 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 69/144] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:51 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:24:52.104031 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-09181bf7-b7af-47fa-9cf9-61b447d1dae9 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:52.104508 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-09181bf7-b7af-47fa-9cf9-61b447d1dae9 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:52.223391 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-09181bf7-b7af-47fa-9cf9-61b447d1dae9 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:52.230376 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-09181bf7-b7af-47fa-9cf9-61b447d1dae9 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.138083 Oct 19 08:24:52.230984 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 76/145] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:52 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:52.655055 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-59912b7b-8f82-41ae-95db-8905f33c61a2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:52.655833 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-59912b7b-8f82-41ae-95db-8905f33c61a2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:52.661658 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-59912b7b-8f82-41ae-95db-8905f33c61a2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:52.662221 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-59912b7b-8f82-41ae-95db-8905f33c61a2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:52.663036 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-59912b7b-8f82-41ae-95db-8905f33c61a2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:52.663527 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-59912b7b-8f82-41ae-95db-8905f33c61a2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:52.663621 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-7ba88340-3cb6-49cc-bf31-0d4e0f0eaa1d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:52.664334 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-7ba88340-3cb6-49cc-bf31-0d4e0f0eaa1d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:52.670759 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7ba88340-3cb6-49cc-bf31-0d4e0f0eaa1d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:52.671205 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7ba88340-3cb6-49cc-bf31-0d4e0f0eaa1d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:52.671968 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7ba88340-3cb6-49cc-bf31-0d4e0f0eaa1d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:52.672393 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7ba88340-3cb6-49cc-bf31-0d4e0f0eaa1d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:53.010286 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-59912b7b-8f82-41ae-95db-8905f33c61a2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:53.014014 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-7ba88340-3cb6-49cc-bf31-0d4e0f0eaa1d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:53.017944 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-59912b7b-8f82-41ae-95db-8905f33c61a2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.367255 Oct 19 08:24:53.018517 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 70/146] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:52 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:53.021692 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-7ba88340-3cb6-49cc-bf31-0d4e0f0eaa1d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:53.022610 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-5a921751-0638-41aa-bd01-6e416297fc4d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:53.023196 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-5a921751-0638-41aa-bd01-6e416297fc4d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:53.023298 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-7ba88340-3cb6-49cc-bf31-0d4e0f0eaa1d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:53.024280 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-7ba88340-3cb6-49cc-bf31-0d4e0f0eaa1d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.364370 Oct 19 08:24:53.024821 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 77/147] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:24:52 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:24:53.029350 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5a921751-0638-41aa-bd01-6e416297fc4d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:53.029779 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5a921751-0638-41aa-bd01-6e416297fc4d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:53.030559 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5a921751-0638-41aa-bd01-6e416297fc4d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:53.030979 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5a921751-0638-41aa-bd01-6e416297fc4d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:53.120121 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c7e9699c-3759-4974-8a42-05371d0827f2 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:53.120719 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-c7e9699c-3759-4974-8a42-05371d0827f2 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:53.127047 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c7e9699c-3759-4974-8a42-05371d0827f2 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:53.127486 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c7e9699c-3759-4974-8a42-05371d0827f2 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:53.128508 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c7e9699c-3759-4974-8a42-05371d0827f2 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:53.128927 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c7e9699c-3759-4974-8a42-05371d0827f2 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:53.148435 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-5a921751-0638-41aa-bd01-6e416297fc4d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:53.155660 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-5a921751-0638-41aa-bd01-6e416297fc4d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.136173 Oct 19 08:24:53.156224 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 71/148] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:53 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:53.249110 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-c7e9699c-3759-4974-8a42-05371d0827f2 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:53.254025 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-6110ac04-d66b-43d3-9a2e-b986c39dbcb5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:53.254729 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-6110ac04-d66b-43d3-9a2e-b986c39dbcb5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:53.256887 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-c7e9699c-3759-4974-8a42-05371d0827f2 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.140258 Oct 19 08:24:53.257670 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 78/149] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:53 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:24:53.260344 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6110ac04-d66b-43d3-9a2e-b986c39dbcb5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:53.260777 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6110ac04-d66b-43d3-9a2e-b986c39dbcb5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:53.261535 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6110ac04-d66b-43d3-9a2e-b986c39dbcb5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:53.261953 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6110ac04-d66b-43d3-9a2e-b986c39dbcb5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:53.377592 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-6110ac04-d66b-43d3-9a2e-b986c39dbcb5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:53.385091 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-6110ac04-d66b-43d3-9a2e-b986c39dbcb5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.141382 Oct 19 08:24:53.385679 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 72/150] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:53 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:24:54.034900 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-055f19dd-10b1-44e3-b69b-e683e81657bd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:54.035504 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-055f19dd-10b1-44e3-b69b-e683e81657bd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:54.041436 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-055f19dd-10b1-44e3-b69b-e683e81657bd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:54.041881 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-055f19dd-10b1-44e3-b69b-e683e81657bd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:54.042147 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-fe29a902-3ea3-4ad2-a1d0-2fed99997145 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:54.042788 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-fe29a902-3ea3-4ad2-a1d0-2fed99997145 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:54.043679 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-055f19dd-10b1-44e3-b69b-e683e81657bd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:54.044328 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-055f19dd-10b1-44e3-b69b-e683e81657bd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:54.048958 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fe29a902-3ea3-4ad2-a1d0-2fed99997145 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:54.049396 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fe29a902-3ea3-4ad2-a1d0-2fed99997145 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:54.050149 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fe29a902-3ea3-4ad2-a1d0-2fed99997145 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:54.050598 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fe29a902-3ea3-4ad2-a1d0-2fed99997145 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:54.221408 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-055f19dd-10b1-44e3-b69b-e683e81657bd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:54.225544 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-fe29a902-3ea3-4ad2-a1d0-2fed99997145 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:54.228914 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-055f19dd-10b1-44e3-b69b-e683e81657bd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.197613 Oct 19 08:24:54.235981 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 79/151] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:54 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:54.236169 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-fe29a902-3ea3-4ad2-a1d0-2fed99997145 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:54.236169 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-fe29a902-3ea3-4ad2-a1d0-2fed99997145 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:54.237335 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-fe29a902-3ea3-4ad2-a1d0-2fed99997145 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.198795 Oct 19 08:24:54.238239 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 73/152] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:24:54 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:24:54.240637 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-eeffaaf0-bb55-40b4-80a9-5bcd335b970c req-cb5224d4-9129-41e5-b59a-070441f0e5a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b75e6c63-1b3e-4a9c-adbc-9db31920288f", "name": "network-vif-plugged", "status": "completed", "tag": "a1452749-7697-4896-9845-e408f2432615"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:24:54.242307 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:24:54.242307 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:24:54.242770 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-93d66fa9-c035-4ffd-ad31-df1de514659d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:54.243345 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-93d66fa9-c035-4ffd-ad31-df1de514659d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:54.251076 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-93d66fa9-c035-4ffd-ad31-df1de514659d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:54.251516 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-93d66fa9-c035-4ffd-ad31-df1de514659d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:54.251743 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-eeffaaf0-bb55-40b4-80a9-5bcd335b970c req-cb5224d4-9129-41e5-b59a-070441f0e5a5 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:54.252276 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-93d66fa9-c035-4ffd-ad31-df1de514659d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:54.252480 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-eeffaaf0-bb55-40b4-80a9-5bcd335b970c req-cb5224d4-9129-41e5-b59a-070441f0e5a5 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:54.252702 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-93d66fa9-c035-4ffd-ad31-df1de514659d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:54.264036 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-eeffaaf0-bb55-40b4-80a9-5bcd335b970c req-cb5224d4-9129-41e5-b59a-070441f0e5a5 service nova] Creating event network-vif-plugged:a1452749-7697-4896-9845-e408f2432615 for instance b75e6c63-1b3e-4a9c-adbc-9db31920288f on hv-cinder-81398 Oct 19 08:24:54.269319 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-eeffaaf0-bb55-40b4-80a9-5bcd335b970c req-cb5224d4-9129-41e5-b59a-070441f0e5a5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038079 Oct 19 08:24:54.269765 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 80/153] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:24:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:24:54.274417 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-9e46791e-3deb-4394-8ca1-a07a37e36e82 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:54.276022 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-9e46791e-3deb-4394-8ca1-a07a37e36e82 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:54.289983 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9e46791e-3deb-4394-8ca1-a07a37e36e82 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:54.290423 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9e46791e-3deb-4394-8ca1-a07a37e36e82 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:54.291219 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9e46791e-3deb-4394-8ca1-a07a37e36e82 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:54.291711 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9e46791e-3deb-4394-8ca1-a07a37e36e82 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:54.547956 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-93d66fa9-c035-4ffd-ad31-df1de514659d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:54.555094 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-93d66fa9-c035-4ffd-ad31-df1de514659d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.315761 Oct 19 08:24:54.560465 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 74/154] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:54 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:54.560622 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-9e46791e-3deb-4394-8ca1-a07a37e36e82 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:54.561384 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3157dbfd-2507-4985-9734-6153da676906 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:54.562786 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3157dbfd-2507-4985-9734-6153da676906 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:54.566131 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-9e46791e-3deb-4394-8ca1-a07a37e36e82 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.295359 Oct 19 08:24:54.566808 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 81/155] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:54 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:54.569688 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3157dbfd-2507-4985-9734-6153da676906 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:54.570297 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3157dbfd-2507-4985-9734-6153da676906 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:54.571097 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3157dbfd-2507-4985-9734-6153da676906 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:54.571521 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3157dbfd-2507-4985-9734-6153da676906 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:54.764257 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3157dbfd-2507-4985-9734-6153da676906 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:54.771249 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3157dbfd-2507-4985-9734-6153da676906 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.214592 Oct 19 08:24:54.771801 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 75/156] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:54 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:55.255373 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-7c2bf782-8161-4af8-970b-7cef1eb4333b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:55.256061 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-7c2bf782-8161-4af8-970b-7cef1eb4333b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:55.258954 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-cb0d7f05-be61-483d-a06a-d96705dddf31 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:55.259592 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-cb0d7f05-be61-483d-a06a-d96705dddf31 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:55.261649 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7c2bf782-8161-4af8-970b-7cef1eb4333b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:55.262088 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7c2bf782-8161-4af8-970b-7cef1eb4333b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:55.263532 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7c2bf782-8161-4af8-970b-7cef1eb4333b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:55.263982 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7c2bf782-8161-4af8-970b-7cef1eb4333b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:55.265778 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cb0d7f05-be61-483d-a06a-d96705dddf31 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:55.266219 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cb0d7f05-be61-483d-a06a-d96705dddf31 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:55.266996 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cb0d7f05-be61-483d-a06a-d96705dddf31 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:55.267438 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cb0d7f05-be61-483d-a06a-d96705dddf31 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:55.437198 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-7c2bf782-8161-4af8-970b-7cef1eb4333b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:55.443574 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-cb0d7f05-be61-483d-a06a-d96705dddf31 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:55.444267 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-7c2bf782-8161-4af8-970b-7cef1eb4333b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.192807 Oct 19 08:24:55.444823 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 82/157] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:55 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:55.451973 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-cb0d7f05-be61-483d-a06a-d96705dddf31 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:55.453473 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-cb0d7f05-be61-483d-a06a-d96705dddf31 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:55.454607 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-cb0d7f05-be61-483d-a06a-d96705dddf31 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.199426 Oct 19 08:24:55.455346 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 76/158] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:24:55 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:24:55.573168 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-87edcbc8-b25f-49fa-8eef-c06550fa6f64 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:55.573766 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-87edcbc8-b25f-49fa-8eef-c06550fa6f64 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:55.580575 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-87edcbc8-b25f-49fa-8eef-c06550fa6f64 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:55.580819 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-87edcbc8-b25f-49fa-8eef-c06550fa6f64 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:55.581572 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-87edcbc8-b25f-49fa-8eef-c06550fa6f64 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:55.582036 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-87edcbc8-b25f-49fa-8eef-c06550fa6f64 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:55.582956 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b7873cff-31c4-4f1f-a10b-542199e1bc18 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:55.583545 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b7873cff-31c4-4f1f-a10b-542199e1bc18 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:55.589414 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b7873cff-31c4-4f1f-a10b-542199e1bc18 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:55.589846 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b7873cff-31c4-4f1f-a10b-542199e1bc18 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:55.590675 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b7873cff-31c4-4f1f-a10b-542199e1bc18 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:55.591302 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b7873cff-31c4-4f1f-a10b-542199e1bc18 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:55.758884 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-b7873cff-31c4-4f1f-a10b-542199e1bc18 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:55.766588 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-87edcbc8-b25f-49fa-8eef-c06550fa6f64 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:55.767072 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b7873cff-31c4-4f1f-a10b-542199e1bc18 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.187741 Oct 19 08:24:55.768059 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 77/159] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:55 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:24:55.773923 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-87edcbc8-b25f-49fa-8eef-c06550fa6f64 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.204383 Oct 19 08:24:55.774469 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 83/160] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:55 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:55.788767 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-2375a21a-77ae-408c-ba3a-d6d2a1dcf682 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:55.789366 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-2375a21a-77ae-408c-ba3a-d6d2a1dcf682 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:55.796540 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2375a21a-77ae-408c-ba3a-d6d2a1dcf682 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:55.796982 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2375a21a-77ae-408c-ba3a-d6d2a1dcf682 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:55.797727 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2375a21a-77ae-408c-ba3a-d6d2a1dcf682 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:55.798159 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2375a21a-77ae-408c-ba3a-d6d2a1dcf682 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:55.928045 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-2375a21a-77ae-408c-ba3a-d6d2a1dcf682 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:55.935466 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-2375a21a-77ae-408c-ba3a-d6d2a1dcf682 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.150466 Oct 19 08:24:55.936017 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 78/161] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:55 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:56.460761 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-e057f0b9-18cc-4e62-b1fd-292ec94461e0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:56.461354 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-e057f0b9-18cc-4e62-b1fd-292ec94461e0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:56.467618 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e057f0b9-18cc-4e62-b1fd-292ec94461e0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:56.468051 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e057f0b9-18cc-4e62-b1fd-292ec94461e0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:56.468794 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e057f0b9-18cc-4e62-b1fd-292ec94461e0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:56.469209 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e057f0b9-18cc-4e62-b1fd-292ec94461e0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:56.471975 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-6f1937b9-3e90-499b-bb21-3d070100bb84 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:56.472594 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-6f1937b9-3e90-499b-bb21-3d070100bb84 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:56.478146 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6f1937b9-3e90-499b-bb21-3d070100bb84 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:56.478593 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6f1937b9-3e90-499b-bb21-3d070100bb84 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:56.479340 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6f1937b9-3e90-499b-bb21-3d070100bb84 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:56.479758 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6f1937b9-3e90-499b-bb21-3d070100bb84 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:56.645396 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-e057f0b9-18cc-4e62-b1fd-292ec94461e0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:56.649975 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-6f1937b9-3e90-499b-bb21-3d070100bb84 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:56.652756 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-e057f0b9-18cc-4e62-b1fd-292ec94461e0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.195559 Oct 19 08:24:56.654071 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 84/162] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:56 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:56.658132 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-6f1937b9-3e90-499b-bb21-3d070100bb84 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:56.659715 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-6f1937b9-3e90-499b-bb21-3d070100bb84 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:56.660880 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-6f1937b9-3e90-499b-bb21-3d070100bb84 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.192518 Oct 19 08:24:56.661489 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 79/163] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:24:56 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:24:56.784391 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-54c7e12b-a874-424d-9a93-cdb310c34d19 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:56.784991 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-54c7e12b-a874-424d-9a93-cdb310c34d19 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:56.790329 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-d593774d-398e-427a-8226-c0a2f40692eb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:56.790807 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-54c7e12b-a874-424d-9a93-cdb310c34d19 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:56.790950 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-d593774d-398e-427a-8226-c0a2f40692eb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:56.791253 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-54c7e12b-a874-424d-9a93-cdb310c34d19 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:56.792094 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-54c7e12b-a874-424d-9a93-cdb310c34d19 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:56.792746 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-54c7e12b-a874-424d-9a93-cdb310c34d19 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:56.797606 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d593774d-398e-427a-8226-c0a2f40692eb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:56.798041 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d593774d-398e-427a-8226-c0a2f40692eb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:56.798822 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d593774d-398e-427a-8226-c0a2f40692eb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:56.799246 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d593774d-398e-427a-8226-c0a2f40692eb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:56.968891 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-54c7e12b-a874-424d-9a93-cdb310c34d19 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:56.973608 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-d593774d-398e-427a-8226-c0a2f40692eb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:56.976186 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-54c7e12b-a874-424d-9a93-cdb310c34d19 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.195316 Oct 19 08:24:56.976756 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 85/164] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:56 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:56.981116 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-34761220-952b-4b68-8a73-9002443a85e1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:56.981877 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-34761220-952b-4b68-8a73-9002443a85e1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:56.981986 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-d593774d-398e-427a-8226-c0a2f40692eb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.194801 Oct 19 08:24:56.989391 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 80/165] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:56 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:24:56.989528 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-34761220-952b-4b68-8a73-9002443a85e1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:56.989528 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-34761220-952b-4b68-8a73-9002443a85e1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:56.989528 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-34761220-952b-4b68-8a73-9002443a85e1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:56.989528 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-34761220-952b-4b68-8a73-9002443a85e1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:57.106351 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-34761220-952b-4b68-8a73-9002443a85e1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:57.113577 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-34761220-952b-4b68-8a73-9002443a85e1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.135822 Oct 19 08:24:57.114122 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 86/166] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:56 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:57.670513 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-666db4c1-ced1-4c1a-a166-68c840f569e2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:57.671116 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-666db4c1-ced1-4c1a-a166-68c840f569e2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:57.677136 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-666db4c1-ced1-4c1a-a166-68c840f569e2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:57.677565 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-666db4c1-ced1-4c1a-a166-68c840f569e2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:57.677870 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-7c4d79f4-42e0-49da-ad2b-938df30bfb3e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:57.678326 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-666db4c1-ced1-4c1a-a166-68c840f569e2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:57.678647 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-7c4d79f4-42e0-49da-ad2b-938df30bfb3e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:57.678770 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-666db4c1-ced1-4c1a-a166-68c840f569e2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:57.684689 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7c4d79f4-42e0-49da-ad2b-938df30bfb3e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:57.685201 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7c4d79f4-42e0-49da-ad2b-938df30bfb3e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:57.686026 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7c4d79f4-42e0-49da-ad2b-938df30bfb3e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:57.686548 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7c4d79f4-42e0-49da-ad2b-938df30bfb3e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:57.857180 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-666db4c1-ced1-4c1a-a166-68c840f569e2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:57.863768 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-7c4d79f4-42e0-49da-ad2b-938df30bfb3e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:57.864395 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-666db4c1-ced1-4c1a-a166-68c840f569e2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.197582 Oct 19 08:24:57.864969 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 81/167] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:57 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:57.871520 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-7c4d79f4-42e0-49da-ad2b-938df30bfb3e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:57.873496 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-7c4d79f4-42e0-49da-ad2b-938df30bfb3e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:57.874620 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-7c4d79f4-42e0-49da-ad2b-938df30bfb3e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.200627 Oct 19 08:24:57.875158 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 87/168] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:24:57 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:24:57.992476 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-03ad472c-4163-4b3f-ae64-b1227ff2e8f4 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:57.993003 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-03ad472c-4163-4b3f-ae64-b1227ff2e8f4 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:57.998518 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-91c580e5-720b-45d1-90ac-5cdf37a8b866 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:57.999130 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-91c580e5-720b-45d1-90ac-5cdf37a8b866 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:57.999626 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-03ad472c-4163-4b3f-ae64-b1227ff2e8f4 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:58.000057 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-03ad472c-4163-4b3f-ae64-b1227ff2e8f4 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:58.000830 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-03ad472c-4163-4b3f-ae64-b1227ff2e8f4 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:58.001245 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-03ad472c-4163-4b3f-ae64-b1227ff2e8f4 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:58.005054 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-91c580e5-720b-45d1-90ac-5cdf37a8b866 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:58.005495 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-91c580e5-720b-45d1-90ac-5cdf37a8b866 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:58.006242 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-91c580e5-720b-45d1-90ac-5cdf37a8b866 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:58.006707 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-91c580e5-720b-45d1-90ac-5cdf37a8b866 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:58.175439 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-03ad472c-4163-4b3f-ae64-b1227ff2e8f4 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:58.180135 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-91c580e5-720b-45d1-90ac-5cdf37a8b866 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:58.182525 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-03ad472c-4163-4b3f-ae64-b1227ff2e8f4 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.193638 Oct 19 08:24:58.183087 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 82/169] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:57 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:58.187810 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ed806edc-9024-448d-beb0-50fa6f88d1d1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:58.187947 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-91c580e5-720b-45d1-90ac-5cdf37a8b866 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.193642 Oct 19 08:24:58.188396 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ed806edc-9024-448d-beb0-50fa6f88d1d1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:58.189254 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 88/170] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:57 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:24:58.193966 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ed806edc-9024-448d-beb0-50fa6f88d1d1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:58.194396 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ed806edc-9024-448d-beb0-50fa6f88d1d1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:58.195170 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ed806edc-9024-448d-beb0-50fa6f88d1d1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:58.195589 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ed806edc-9024-448d-beb0-50fa6f88d1d1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:58.313508 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ed806edc-9024-448d-beb0-50fa6f88d1d1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:58.320359 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ed806edc-9024-448d-beb0-50fa6f88d1d1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.136359 Oct 19 08:24:58.320909 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 83/171] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:58 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:58.881980 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2db48d29-c210-4b0b-91c7-b91a9eb01a93 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:58.882603 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2db48d29-c210-4b0b-91c7-b91a9eb01a93 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:58.888913 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2db48d29-c210-4b0b-91c7-b91a9eb01a93 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:58.889347 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2db48d29-c210-4b0b-91c7-b91a9eb01a93 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:58.890097 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2db48d29-c210-4b0b-91c7-b91a9eb01a93 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:58.890534 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2db48d29-c210-4b0b-91c7-b91a9eb01a93 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:58.892675 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3dcd69aa-124a-45f1-8847-0d0c1ec62586 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:58.893278 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3dcd69aa-124a-45f1-8847-0d0c1ec62586 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:58.898908 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3dcd69aa-124a-45f1-8847-0d0c1ec62586 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:58.899350 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3dcd69aa-124a-45f1-8847-0d0c1ec62586 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:58.900110 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3dcd69aa-124a-45f1-8847-0d0c1ec62586 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:58.900534 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3dcd69aa-124a-45f1-8847-0d0c1ec62586 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:59.065001 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-2db48d29-c210-4b0b-91c7-b91a9eb01a93 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:59.071562 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3dcd69aa-124a-45f1-8847-0d0c1ec62586 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:59.072324 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2db48d29-c210-4b0b-91c7-b91a9eb01a93 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.194232 Oct 19 08:24:59.072888 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 89/172] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:58 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:59.080217 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3dcd69aa-124a-45f1-8847-0d0c1ec62586 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:59.081691 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3dcd69aa-124a-45f1-8847-0d0c1ec62586 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:59.082786 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3dcd69aa-124a-45f1-8847-0d0c1ec62586 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.193811 Oct 19 08:24:59.083320 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 84/173] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:24:58 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:24:59.199648 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-0570d99e-1912-483a-a05f-b1be3047037f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:59.200881 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-0570d99e-1912-483a-a05f-b1be3047037f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:59.206726 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-6a077dc4-b836-4c2e-927e-d8f2174ff9e2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:59.206899 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0570d99e-1912-483a-a05f-b1be3047037f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:59.207251 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0570d99e-1912-483a-a05f-b1be3047037f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:59.207666 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-6a077dc4-b836-4c2e-927e-d8f2174ff9e2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:59.209110 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0570d99e-1912-483a-a05f-b1be3047037f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:59.209610 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0570d99e-1912-483a-a05f-b1be3047037f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:59.213954 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6a077dc4-b836-4c2e-927e-d8f2174ff9e2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:59.214385 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6a077dc4-b836-4c2e-927e-d8f2174ff9e2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:59.215170 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6a077dc4-b836-4c2e-927e-d8f2174ff9e2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:59.215626 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6a077dc4-b836-4c2e-927e-d8f2174ff9e2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:59.383066 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-6a077dc4-b836-4c2e-927e-d8f2174ff9e2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:59.388195 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-0570d99e-1912-483a-a05f-b1be3047037f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:59.391525 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-6a077dc4-b836-4c2e-927e-d8f2174ff9e2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.189926 Oct 19 08:24:59.392088 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 85/174] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:59 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:24:59.395787 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-0570d99e-1912-483a-a05f-b1be3047037f tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.199663 Oct 19 08:24:59.396413 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-facff31c-2d31-472c-a396-cd64c1278f59 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:24:59.396534 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 90/175] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:59 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:24:59.396853 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-facff31c-2d31-472c-a396-cd64c1278f59 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:24:59.402454 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-facff31c-2d31-472c-a396-cd64c1278f59 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:59.402947 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-facff31c-2d31-472c-a396-cd64c1278f59 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:59.403855 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-facff31c-2d31-472c-a396-cd64c1278f59 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:24:59.404280 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-facff31c-2d31-472c-a396-cd64c1278f59 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:24:59.521809 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-facff31c-2d31-472c-a396-cd64c1278f59 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:24:59.528997 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-facff31c-2d31-472c-a396-cd64c1278f59 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.135890 Oct 19 08:24:59.529552 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 86/176] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:24:59 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:00.088737 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-1d55b481-90d3-4f5e-a7a1-21768bc961fe tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:00.089333 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-1d55b481-90d3-4f5e-a7a1-21768bc961fe tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:00.096118 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1d55b481-90d3-4f5e-a7a1-21768bc961fe tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:00.096551 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1d55b481-90d3-4f5e-a7a1-21768bc961fe tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:00.097416 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1d55b481-90d3-4f5e-a7a1-21768bc961fe tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:00.097842 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1d55b481-90d3-4f5e-a7a1-21768bc961fe tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:00.100368 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-4577ed06-a3ae-4ead-bab6-369517232357 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:00.100966 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-4577ed06-a3ae-4ead-bab6-369517232357 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:00.107358 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4577ed06-a3ae-4ead-bab6-369517232357 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:00.107800 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4577ed06-a3ae-4ead-bab6-369517232357 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:00.108561 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4577ed06-a3ae-4ead-bab6-369517232357 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:00.108985 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4577ed06-a3ae-4ead-bab6-369517232357 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:00.270663 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-1d55b481-90d3-4f5e-a7a1-21768bc961fe tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:00.277404 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-4577ed06-a3ae-4ead-bab6-369517232357 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:00.277781 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-1d55b481-90d3-4f5e-a7a1-21768bc961fe tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.192599 Oct 19 08:25:00.278999 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 91/177] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:00 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:00.285742 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-4577ed06-a3ae-4ead-bab6-369517232357 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:00.287342 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-4577ed06-a3ae-4ead-bab6-369517232357 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:00.288424 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-4577ed06-a3ae-4ead-bab6-369517232357 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.191673 Oct 19 08:25:00.288965 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 87/178] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:25:00 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:25:00.409163 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-b8693217-49f3-4335-b1ba-f5ad16b698b4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:00.409847 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-b8693217-49f3-4335-b1ba-f5ad16b698b4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:00.411950 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-fba50022-a0a3-4dc5-84b4-594e143b2e96 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:00.412569 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-fba50022-a0a3-4dc5-84b4-594e143b2e96 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:00.415766 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b8693217-49f3-4335-b1ba-f5ad16b698b4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:00.416204 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b8693217-49f3-4335-b1ba-f5ad16b698b4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:00.416970 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b8693217-49f3-4335-b1ba-f5ad16b698b4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:00.417395 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b8693217-49f3-4335-b1ba-f5ad16b698b4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:00.418167 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fba50022-a0a3-4dc5-84b4-594e143b2e96 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:00.418680 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fba50022-a0a3-4dc5-84b4-594e143b2e96 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:00.419449 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fba50022-a0a3-4dc5-84b4-594e143b2e96 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:00.419865 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fba50022-a0a3-4dc5-84b4-594e143b2e96 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:00.594252 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-b8693217-49f3-4335-b1ba-f5ad16b698b4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:00.597623 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-fba50022-a0a3-4dc5-84b4-594e143b2e96 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:00.602204 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-b8693217-49f3-4335-b1ba-f5ad16b698b4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.196765 Oct 19 08:25:00.603048 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 92/179] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:00 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:00.605587 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-fba50022-a0a3-4dc5-84b4-594e143b2e96 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.197266 Oct 19 08:25:00.606574 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 88/180] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:00 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:25:00.618558 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-45a3c536-020e-4841-b3da-b85bda964879 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:00.618558 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-45a3c536-020e-4841-b3da-b85bda964879 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:00.623956 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-45a3c536-020e-4841-b3da-b85bda964879 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:00.624385 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-45a3c536-020e-4841-b3da-b85bda964879 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:00.625127 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-45a3c536-020e-4841-b3da-b85bda964879 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:00.625543 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-45a3c536-020e-4841-b3da-b85bda964879 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:00.741666 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-45a3c536-020e-4841-b3da-b85bda964879 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:00.749576 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-45a3c536-020e-4841-b3da-b85bda964879 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.136332 Oct 19 08:25:00.750124 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 93/181] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:00 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:01.295278 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-99b620fe-9827-4ca1-b961-f06695565b9a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:01.295883 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-99b620fe-9827-4ca1-b961-f06695565b9a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:01.301843 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-99b620fe-9827-4ca1-b961-f06695565b9a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:01.302284 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-99b620fe-9827-4ca1-b961-f06695565b9a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:01.303082 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-99b620fe-9827-4ca1-b961-f06695565b9a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:01.303628 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-99b620fe-9827-4ca1-b961-f06695565b9a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:01.306723 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-742e1432-4b4f-4a9a-870d-0575b77043fa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:01.307325 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-742e1432-4b4f-4a9a-870d-0575b77043fa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:01.314379 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-742e1432-4b4f-4a9a-870d-0575b77043fa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:01.314851 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-742e1432-4b4f-4a9a-870d-0575b77043fa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:01.315595 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-742e1432-4b4f-4a9a-870d-0575b77043fa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:01.316017 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-742e1432-4b4f-4a9a-870d-0575b77043fa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:01.489004 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-99b620fe-9827-4ca1-b961-f06695565b9a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:01.491502 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-742e1432-4b4f-4a9a-870d-0575b77043fa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:01.496146 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-99b620fe-9827-4ca1-b961-f06695565b9a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.204940 Oct 19 08:25:01.496716 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 89/182] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:01 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:01.499297 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-742e1432-4b4f-4a9a-870d-0575b77043fa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:01.500764 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-742e1432-4b4f-4a9a-870d-0575b77043fa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:01.501835 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-742e1432-4b4f-4a9a-870d-0575b77043fa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.199223 Oct 19 08:25:01.502369 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 94/183] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:25:01 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:25:01.619580 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-6bc8596b-f2fe-4b18-a34e-efb774ccf386 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:01.620177 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-6bc8596b-f2fe-4b18-a34e-efb774ccf386 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:01.621186 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-857ae7fa-68a9-4cd5-90e2-1e6f00526ddd tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:01.622083 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-857ae7fa-68a9-4cd5-90e2-1e6f00526ddd tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:01.626344 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6bc8596b-f2fe-4b18-a34e-efb774ccf386 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:01.626817 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6bc8596b-f2fe-4b18-a34e-efb774ccf386 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:01.627653 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6bc8596b-f2fe-4b18-a34e-efb774ccf386 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:01.628205 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-857ae7fa-68a9-4cd5-90e2-1e6f00526ddd tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:01.628313 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6bc8596b-f2fe-4b18-a34e-efb774ccf386 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:01.628651 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-857ae7fa-68a9-4cd5-90e2-1e6f00526ddd tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:01.629467 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-857ae7fa-68a9-4cd5-90e2-1e6f00526ddd tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:01.629799 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-857ae7fa-68a9-4cd5-90e2-1e6f00526ddd tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:01.802455 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-6bc8596b-f2fe-4b18-a34e-efb774ccf386 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:01.807391 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-857ae7fa-68a9-4cd5-90e2-1e6f00526ddd tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:01.809792 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-6bc8596b-f2fe-4b18-a34e-efb774ccf386 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.193731 Oct 19 08:25:01.810467 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 90/184] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:01 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:01.814803 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-acb9980b-b2be-4197-ad23-61753a77df8b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:01.815236 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-857ae7fa-68a9-4cd5-90e2-1e6f00526ddd tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.197554 Oct 19 08:25:01.815394 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-acb9980b-b2be-4197-ad23-61753a77df8b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:01.815792 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 95/185] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:01 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:25:01.820998 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-acb9980b-b2be-4197-ad23-61753a77df8b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:01.821434 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-acb9980b-b2be-4197-ad23-61753a77df8b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:01.822181 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-acb9980b-b2be-4197-ad23-61753a77df8b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:01.822625 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-acb9980b-b2be-4197-ad23-61753a77df8b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:01.940038 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-acb9980b-b2be-4197-ad23-61753a77df8b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:01.947046 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-acb9980b-b2be-4197-ad23-61753a77df8b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.135473 Oct 19 08:25:01.947604 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 91/186] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:01 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:02.513392 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-034ac109-a565-4560-8db8-a7917c586a13 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:02.513988 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-034ac109-a565-4560-8db8-a7917c586a13 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:02.519049 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a86198d9-b254-455b-92e0-b9d1f2e4ca0c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:02.519652 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a86198d9-b254-455b-92e0-b9d1f2e4ca0c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:02.519788 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-034ac109-a565-4560-8db8-a7917c586a13 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:02.520224 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-034ac109-a565-4560-8db8-a7917c586a13 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:02.520973 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-034ac109-a565-4560-8db8-a7917c586a13 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:02.521390 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-034ac109-a565-4560-8db8-a7917c586a13 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:02.525266 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a86198d9-b254-455b-92e0-b9d1f2e4ca0c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:02.525718 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a86198d9-b254-455b-92e0-b9d1f2e4ca0c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:02.526472 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a86198d9-b254-455b-92e0-b9d1f2e4ca0c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:02.526924 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a86198d9-b254-455b-92e0-b9d1f2e4ca0c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:02.848726 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-034ac109-a565-4560-8db8-a7917c586a13 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:02.853225 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a86198d9-b254-455b-92e0-b9d1f2e4ca0c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:02.857163 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-034ac109-a565-4560-8db8-a7917c586a13 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.347056 Oct 19 08:25:02.857953 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 96/187] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:02 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:02.861799 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a86198d9-b254-455b-92e0-b9d1f2e4ca0c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:02.862166 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2b703c81-5125-434e-846c-1b00262bbc7b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:02.862780 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2b703c81-5125-434e-846c-1b00262bbc7b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:02.863330 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a86198d9-b254-455b-92e0-b9d1f2e4ca0c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:02.864412 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a86198d9-b254-455b-92e0-b9d1f2e4ca0c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.348966 Oct 19 08:25:02.872782 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 92/188] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:25:02 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:25:02.872940 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2b703c81-5125-434e-846c-1b00262bbc7b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:02.872940 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2b703c81-5125-434e-846c-1b00262bbc7b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:02.873125 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-16e45635-7762-419f-af8d-7541dee19404 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:02.873203 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2b703c81-5125-434e-846c-1b00262bbc7b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:02.873276 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-16e45635-7762-419f-af8d-7541dee19404 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:02.873345 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2b703c81-5125-434e-846c-1b00262bbc7b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:02.876018 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-16e45635-7762-419f-af8d-7541dee19404 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:02.876448 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-16e45635-7762-419f-af8d-7541dee19404 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:02.877192 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-16e45635-7762-419f-af8d-7541dee19404 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:02.877606 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-16e45635-7762-419f-af8d-7541dee19404 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:03.047796 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-2b703c81-5125-434e-846c-1b00262bbc7b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:03.050446 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-16e45635-7762-419f-af8d-7541dee19404 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:03.055061 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2b703c81-5125-434e-846c-1b00262bbc7b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.196169 Oct 19 08:25:03.055695 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 97/189] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:02 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:03.057880 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-16e45635-7762-419f-af8d-7541dee19404 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.191188 Oct 19 08:25:03.058588 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 93/190] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:02 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:03.060390 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-48fd13ce-c864-4b65-aafd-00d2449f5127 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:03.061052 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-48fd13ce-c864-4b65-aafd-00d2449f5127 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:03.066606 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-48fd13ce-c864-4b65-aafd-00d2449f5127 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:03.067110 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-48fd13ce-c864-4b65-aafd-00d2449f5127 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:03.067890 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-48fd13ce-c864-4b65-aafd-00d2449f5127 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:03.068307 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-48fd13ce-c864-4b65-aafd-00d2449f5127 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:03.184983 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-48fd13ce-c864-4b65-aafd-00d2449f5127 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:03.192043 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-48fd13ce-c864-4b65-aafd-00d2449f5127 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.135348 Oct 19 08:25:03.192599 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 98/191] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:03 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:03.874533 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3deac2c0-7dbb-4f6c-880e-b4a1e7744e1c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:03.875132 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3deac2c0-7dbb-4f6c-880e-b4a1e7744e1c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:03.881181 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3deac2c0-7dbb-4f6c-880e-b4a1e7744e1c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:03.881608 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3deac2c0-7dbb-4f6c-880e-b4a1e7744e1c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:03.881861 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-63c665b4-9c2e-47c6-9e83-1bcf61d44a65 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:03.882352 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3deac2c0-7dbb-4f6c-880e-b4a1e7744e1c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:03.882446 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-63c665b4-9c2e-47c6-9e83-1bcf61d44a65 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:03.882793 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3deac2c0-7dbb-4f6c-880e-b4a1e7744e1c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:03.889368 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-63c665b4-9c2e-47c6-9e83-1bcf61d44a65 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:03.889804 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-63c665b4-9c2e-47c6-9e83-1bcf61d44a65 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:03.890623 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-63c665b4-9c2e-47c6-9e83-1bcf61d44a65 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:03.891040 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-63c665b4-9c2e-47c6-9e83-1bcf61d44a65 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:04.056403 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-63c665b4-9c2e-47c6-9e83-1bcf61d44a65 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:04.066902 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3deac2c0-7dbb-4f6c-880e-b4a1e7744e1c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:04.067002 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-63c665b4-9c2e-47c6-9e83-1bcf61d44a65 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:04.067846 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-63c665b4-9c2e-47c6-9e83-1bcf61d44a65 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:04.069436 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-63c665b4-9c2e-47c6-9e83-1bcf61d44a65 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.191006 Oct 19 08:25:04.069719 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 99/192] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:25:03 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:25:04.073939 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-01035ae3-ab1d-4a96-8236-c328382355d8 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:04.074545 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-01035ae3-ab1d-4a96-8236-c328382355d8 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:04.080759 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-01035ae3-ab1d-4a96-8236-c328382355d8 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:04.081189 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-01035ae3-ab1d-4a96-8236-c328382355d8 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:04.081934 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-01035ae3-ab1d-4a96-8236-c328382355d8 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:04.082358 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-01035ae3-ab1d-4a96-8236-c328382355d8 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:04.082704 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3deac2c0-7dbb-4f6c-880e-b4a1e7744e1c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.212260 Oct 19 08:25:04.083293 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 94/193] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:03 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:04.087441 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-853d7ab0-d0bc-4a1c-82e7-be38b6d44231 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:04.088033 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-853d7ab0-d0bc-4a1c-82e7-be38b6d44231 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:04.093657 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-853d7ab0-d0bc-4a1c-82e7-be38b6d44231 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:04.094099 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-853d7ab0-d0bc-4a1c-82e7-be38b6d44231 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:04.094875 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-853d7ab0-d0bc-4a1c-82e7-be38b6d44231 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:04.095298 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-853d7ab0-d0bc-4a1c-82e7-be38b6d44231 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:04.259599 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-01035ae3-ab1d-4a96-8236-c328382355d8 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:04.266527 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-853d7ab0-d0bc-4a1c-82e7-be38b6d44231 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:04.266790 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-01035ae3-ab1d-4a96-8236-c328382355d8 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.196056 Oct 19 08:25:04.267351 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 100/194] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:04 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:04.271604 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-553de6fd-dec6-4862-a7c6-f4c60b73b0a9 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:04.272133 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-553de6fd-dec6-4862-a7c6-f4c60b73b0a9 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:04.274175 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-853d7ab0-d0bc-4a1c-82e7-be38b6d44231 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.189952 Oct 19 08:25:04.274760 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 95/195] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:04 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:04.277938 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-553de6fd-dec6-4862-a7c6-f4c60b73b0a9 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:04.278368 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-553de6fd-dec6-4862-a7c6-f4c60b73b0a9 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:04.279137 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-553de6fd-dec6-4862-a7c6-f4c60b73b0a9 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:04.279556 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-553de6fd-dec6-4862-a7c6-f4c60b73b0a9 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:04.397617 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-553de6fd-dec6-4862-a7c6-f4c60b73b0a9 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:04.405229 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-553de6fd-dec6-4862-a7c6-f4c60b73b0a9 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.136932 Oct 19 08:25:04.405824 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 101/196] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:04 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:05.086386 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-33903487-ea61-4fe1-ba1b-dc72e1125df4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:05.087006 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-33903487-ea61-4fe1-ba1b-dc72e1125df4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:05.093423 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-33903487-ea61-4fe1-ba1b-dc72e1125df4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:05.094013 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-33903487-ea61-4fe1-ba1b-dc72e1125df4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:05.094659 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-33903487-ea61-4fe1-ba1b-dc72e1125df4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:05.095087 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-33903487-ea61-4fe1-ba1b-dc72e1125df4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:05.099920 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-94327fef-e028-4cb1-a671-eb5f6e326407 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:05.100417 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-94327fef-e028-4cb1-a671-eb5f6e326407 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:05.106248 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-94327fef-e028-4cb1-a671-eb5f6e326407 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:05.107016 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-94327fef-e028-4cb1-a671-eb5f6e326407 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:05.107782 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-94327fef-e028-4cb1-a671-eb5f6e326407 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:05.108208 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-94327fef-e028-4cb1-a671-eb5f6e326407 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:05.272116 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-33903487-ea61-4fe1-ba1b-dc72e1125df4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:05.280031 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-33903487-ea61-4fe1-ba1b-dc72e1125df4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:05.280340 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-94327fef-e028-4cb1-a671-eb5f6e326407 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:05.281526 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-33903487-ea61-4fe1-ba1b-dc72e1125df4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:05.282755 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-33903487-ea61-4fe1-ba1b-dc72e1125df4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.199907 Oct 19 08:25:05.283528 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 96/197] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:25:05 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:25:05.288966 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-464b7e10-dcc8-4a56-a013-da8329b9b965 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:05.289563 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-464b7e10-dcc8-4a56-a013-da8329b9b965 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:05.295498 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-464b7e10-dcc8-4a56-a013-da8329b9b965 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:05.295943 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-464b7e10-dcc8-4a56-a013-da8329b9b965 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:05.296696 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-464b7e10-dcc8-4a56-a013-da8329b9b965 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:05.297147 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-464b7e10-dcc8-4a56-a013-da8329b9b965 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:05.297501 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-94327fef-e028-4cb1-a671-eb5f6e326407 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.202358 Oct 19 08:25:05.306989 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 102/198] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:05 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:25:05.306989 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c8654dd8-9936-4b8f-bd5a-dcceeeb6050c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:05.306989 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-c8654dd8-9936-4b8f-bd5a-dcceeeb6050c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:05.311311 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c8654dd8-9936-4b8f-bd5a-dcceeeb6050c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:05.312271 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c8654dd8-9936-4b8f-bd5a-dcceeeb6050c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:05.312516 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c8654dd8-9936-4b8f-bd5a-dcceeeb6050c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:05.312938 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c8654dd8-9936-4b8f-bd5a-dcceeeb6050c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:05.478418 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-464b7e10-dcc8-4a56-a013-da8329b9b965 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:05.486028 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-c8654dd8-9936-4b8f-bd5a-dcceeeb6050c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:05.486432 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-464b7e10-dcc8-4a56-a013-da8329b9b965 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.202152 Oct 19 08:25:05.487028 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 97/199] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:05 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:05.491404 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-13c96eaa-2224-4537-b749-31dc4e4e7d56 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:05.492218 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-13c96eaa-2224-4537-b749-31dc4e4e7d56 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:05.499289 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-13c96eaa-2224-4537-b749-31dc4e4e7d56 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:05.499550 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-13c96eaa-2224-4537-b749-31dc4e4e7d56 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:05.500314 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-13c96eaa-2224-4537-b749-31dc4e4e7d56 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:05.500735 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-13c96eaa-2224-4537-b749-31dc4e4e7d56 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:05.501566 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-c8654dd8-9936-4b8f-bd5a-dcceeeb6050c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.202471 Oct 19 08:25:05.502276 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 103/200] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:05 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:05.621404 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-13c96eaa-2224-4537-b749-31dc4e4e7d56 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:05.629525 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-13c96eaa-2224-4537-b749-31dc4e4e7d56 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.141421 Oct 19 08:25:05.630075 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 98/201] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:05 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:06.299346 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-ce113da7-d219-4329-bd59-834746e8dff6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:06.299941 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-ce113da7-d219-4329-bd59-834746e8dff6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:06.305865 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ce113da7-d219-4329-bd59-834746e8dff6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:06.306307 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ce113da7-d219-4329-bd59-834746e8dff6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:06.307155 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ce113da7-d219-4329-bd59-834746e8dff6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:06.307634 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ce113da7-d219-4329-bd59-834746e8dff6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:06.314283 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-46789225-d890-4385-8f7a-87d9d1fc7af1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:06.314913 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-46789225-d890-4385-8f7a-87d9d1fc7af1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:06.320596 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-46789225-d890-4385-8f7a-87d9d1fc7af1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:06.321039 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-46789225-d890-4385-8f7a-87d9d1fc7af1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:06.321795 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-46789225-d890-4385-8f7a-87d9d1fc7af1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:06.322225 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-46789225-d890-4385-8f7a-87d9d1fc7af1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:06.483775 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-ce113da7-d219-4329-bd59-834746e8dff6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:06.491491 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-ce113da7-d219-4329-bd59-834746e8dff6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:06.493062 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-ce113da7-d219-4329-bd59-834746e8dff6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:06.494154 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-ce113da7-d219-4329-bd59-834746e8dff6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.198465 Oct 19 08:25:06.494737 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 104/202] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:25:06 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:25:06.495117 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-46789225-d890-4385-8f7a-87d9d1fc7af1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:06.502743 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-46789225-d890-4385-8f7a-87d9d1fc7af1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.192043 Oct 19 08:25:06.503309 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-cef77d78-f5e0-4329-9ede-64ef317b70b6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:06.504052 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-cef77d78-f5e0-4329-9ede-64ef317b70b6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:06.508687 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 99/203] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:06 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:25:06.511815 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cef77d78-f5e0-4329-9ede-64ef317b70b6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:06.512783 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cef77d78-f5e0-4329-9ede-64ef317b70b6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:06.513662 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cef77d78-f5e0-4329-9ede-64ef317b70b6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:06.514275 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cef77d78-f5e0-4329-9ede-64ef317b70b6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:06.519042 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-97cdb0f2-4e34-47f3-ab13-afd96b094b08 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:06.519719 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-97cdb0f2-4e34-47f3-ab13-afd96b094b08 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:06.525940 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-97cdb0f2-4e34-47f3-ab13-afd96b094b08 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:06.526381 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-97cdb0f2-4e34-47f3-ab13-afd96b094b08 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:06.527198 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-97cdb0f2-4e34-47f3-ab13-afd96b094b08 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:06.527622 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-97cdb0f2-4e34-47f3-ab13-afd96b094b08 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:06.710793 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-cef77d78-f5e0-4329-9ede-64ef317b70b6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:06.718129 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-cef77d78-f5e0-4329-9ede-64ef317b70b6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.218714 Oct 19 08:25:06.718390 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-97cdb0f2-4e34-47f3-ab13-afd96b094b08 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:06.722206 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 105/204] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:06 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:25:06.722906 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-71706783-04b8-4442-87aa-b2ae284d0276 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:06.723497 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-71706783-04b8-4442-87aa-b2ae284d0276 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:06.728274 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-97cdb0f2-4e34-47f3-ab13-afd96b094b08 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.212702 Oct 19 08:25:06.729091 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-71706783-04b8-4442-87aa-b2ae284d0276 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:06.729329 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 100/205] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:06 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:06.729535 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-71706783-04b8-4442-87aa-b2ae284d0276 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:06.730291 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-71706783-04b8-4442-87aa-b2ae284d0276 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:06.730995 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-71706783-04b8-4442-87aa-b2ae284d0276 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:06.865914 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-71706783-04b8-4442-87aa-b2ae284d0276 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:06.876952 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-71706783-04b8-4442-87aa-b2ae284d0276 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.156957 Oct 19 08:25:06.887676 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 106/206] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:06 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:07.513504 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-72a841e6-f8c3-4277-8bfc-bb892942aefa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:07.514157 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-72a841e6-f8c3-4277-8bfc-bb892942aefa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:07.519204 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-073eb9db-aabb-46e2-9708-5823bc3e145d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:07.519940 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-073eb9db-aabb-46e2-9708-5823bc3e145d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:07.520074 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-72a841e6-f8c3-4277-8bfc-bb892942aefa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:07.520473 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-72a841e6-f8c3-4277-8bfc-bb892942aefa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:07.521250 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-72a841e6-f8c3-4277-8bfc-bb892942aefa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:07.521679 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-72a841e6-f8c3-4277-8bfc-bb892942aefa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:07.525837 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-073eb9db-aabb-46e2-9708-5823bc3e145d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:07.526342 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-073eb9db-aabb-46e2-9708-5823bc3e145d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:07.527197 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-073eb9db-aabb-46e2-9708-5823bc3e145d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:07.527689 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-073eb9db-aabb-46e2-9708-5823bc3e145d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:07.709383 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-72a841e6-f8c3-4277-8bfc-bb892942aefa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:07.714350 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-073eb9db-aabb-46e2-9708-5823bc3e145d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:07.718510 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-72a841e6-f8c3-4277-8bfc-bb892942aefa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:07.720178 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-72a841e6-f8c3-4277-8bfc-bb892942aefa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:07.721302 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-72a841e6-f8c3-4277-8bfc-bb892942aefa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.212009 Oct 19 08:25:07.722048 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 101/207] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:25:07 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:25:07.722558 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-073eb9db-aabb-46e2-9708-5823bc3e145d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.207034 Oct 19 08:25:07.723193 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 107/208] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:07 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:25:07.735962 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-5442b740-266a-4fdc-ae09-539c9e42e66c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:07.736560 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-5442b740-266a-4fdc-ae09-539c9e42e66c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:07.742549 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5442b740-266a-4fdc-ae09-539c9e42e66c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:07.743000 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5442b740-266a-4fdc-ae09-539c9e42e66c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:07.743767 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5442b740-266a-4fdc-ae09-539c9e42e66c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:07.744198 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5442b740-266a-4fdc-ae09-539c9e42e66c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:07.746788 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c2534f5b-e599-4125-9d68-f4230e60fc0d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:07.747400 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-c2534f5b-e599-4125-9d68-f4230e60fc0d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:07.753925 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c2534f5b-e599-4125-9d68-f4230e60fc0d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:07.754371 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c2534f5b-e599-4125-9d68-f4230e60fc0d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:07.755176 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c2534f5b-e599-4125-9d68-f4230e60fc0d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:07.755612 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c2534f5b-e599-4125-9d68-f4230e60fc0d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:07.955297 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-5442b740-266a-4fdc-ae09-539c9e42e66c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:07.963239 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-5442b740-266a-4fdc-ae09-539c9e42e66c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.230925 Oct 19 08:25:07.964138 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 102/209] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:07 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:07.965080 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-c2534f5b-e599-4125-9d68-f4230e60fc0d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:07.969130 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-9bece062-ea34-44f6-a9db-1cf5b5f53fee tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:07.969732 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-9bece062-ea34-44f6-a9db-1cf5b5f53fee tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:07.974522 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-c2534f5b-e599-4125-9d68-f4230e60fc0d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.231697 Oct 19 08:25:07.975860 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 108/210] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:07 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:25:07.976086 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9bece062-ea34-44f6-a9db-1cf5b5f53fee tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:07.976347 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9bece062-ea34-44f6-a9db-1cf5b5f53fee tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:07.977122 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9bece062-ea34-44f6-a9db-1cf5b5f53fee tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:07.977548 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9bece062-ea34-44f6-a9db-1cf5b5f53fee tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:08.140921 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-9bece062-ea34-44f6-a9db-1cf5b5f53fee tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:08.148265 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-9bece062-ea34-44f6-a9db-1cf5b5f53fee tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.183187 Oct 19 08:25:08.148930 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 103/211] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:07 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:08.739868 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-263852be-08b6-4ef0-8517-ddd7829910e0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:08.740473 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-263852be-08b6-4ef0-8517-ddd7829910e0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:08.740599 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-dfc68ea6-6508-4be4-8056-6f4f505727aa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:08.741193 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-dfc68ea6-6508-4be4-8056-6f4f505727aa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:08.746148 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-263852be-08b6-4ef0-8517-ddd7829910e0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:08.747356 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-263852be-08b6-4ef0-8517-ddd7829910e0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:08.747536 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-dfc68ea6-6508-4be4-8056-6f4f505727aa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:08.747963 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-dfc68ea6-6508-4be4-8056-6f4f505727aa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:08.748252 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-263852be-08b6-4ef0-8517-ddd7829910e0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:08.748729 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-dfc68ea6-6508-4be4-8056-6f4f505727aa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:08.748831 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-263852be-08b6-4ef0-8517-ddd7829910e0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:08.749155 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-dfc68ea6-6508-4be4-8056-6f4f505727aa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:08.926749 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-dfc68ea6-6508-4be4-8056-6f4f505727aa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:08.933747 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-263852be-08b6-4ef0-8517-ddd7829910e0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:08.934990 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-dfc68ea6-6508-4be4-8056-6f4f505727aa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.197571 Oct 19 08:25:08.935558 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 104/212] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:08 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:25:08.942644 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-263852be-08b6-4ef0-8517-ddd7829910e0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:08.944119 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-263852be-08b6-4ef0-8517-ddd7829910e0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:08.945192 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-263852be-08b6-4ef0-8517-ddd7829910e0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.208960 Oct 19 08:25:08.945722 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 109/213] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:25:08 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:25:08.980294 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-dea522bb-831b-42d0-a444-883a11cbe2d7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:08.981633 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-dea522bb-831b-42d0-a444-883a11cbe2d7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:08.988324 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-dea522bb-831b-42d0-a444-883a11cbe2d7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:08.988764 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-dea522bb-831b-42d0-a444-883a11cbe2d7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:08.989891 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-dea522bb-831b-42d0-a444-883a11cbe2d7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:08.990328 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-dea522bb-831b-42d0-a444-883a11cbe2d7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:08.991394 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-7c76138c-b712-432c-9c5d-ec7645912d56 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:08.991996 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-7c76138c-b712-432c-9c5d-ec7645912d56 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:08.997930 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7c76138c-b712-432c-9c5d-ec7645912d56 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:08.998533 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7c76138c-b712-432c-9c5d-ec7645912d56 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:08.999180 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7c76138c-b712-432c-9c5d-ec7645912d56 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:08.999603 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7c76138c-b712-432c-9c5d-ec7645912d56 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:09.165776 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-7c76138c-b712-432c-9c5d-ec7645912d56 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:09.173972 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-7c76138c-b712-432c-9c5d-ec7645912d56 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.186332 Oct 19 08:25:09.182085 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 110/214] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:08 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:25:09.182442 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-dea522bb-831b-42d0-a444-883a11cbe2d7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:09.182573 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8b0840f3-9713-46d3-80df-cb9b1b7c6bf9 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:09.182573 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-8b0840f3-9713-46d3-80df-cb9b1b7c6bf9 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:09.186828 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-dea522bb-831b-42d0-a444-883a11cbe2d7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.209923 Oct 19 08:25:09.187300 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8b0840f3-9713-46d3-80df-cb9b1b7c6bf9 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:09.187615 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 105/215] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:08 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:09.187889 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8b0840f3-9713-46d3-80df-cb9b1b7c6bf9 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:09.188752 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8b0840f3-9713-46d3-80df-cb9b1b7c6bf9 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:09.189290 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8b0840f3-9713-46d3-80df-cb9b1b7c6bf9 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:09.311316 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-8b0840f3-9713-46d3-80df-cb9b1b7c6bf9 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:09.318399 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-8b0840f3-9713-46d3-80df-cb9b1b7c6bf9 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.142892 Oct 19 08:25:09.318994 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 111/216] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:09 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:09.955121 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a334e6d8-b73e-4198-99a4-6405fab7078e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:09.955823 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a334e6d8-b73e-4198-99a4-6405fab7078e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:09.963362 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-af28dea3-c79e-4c1a-855a-2091a97d701c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:09.963809 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a334e6d8-b73e-4198-99a4-6405fab7078e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:09.963893 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a334e6d8-b73e-4198-99a4-6405fab7078e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:09.964610 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a334e6d8-b73e-4198-99a4-6405fab7078e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:09.964950 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-af28dea3-c79e-4c1a-855a-2091a97d701c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:09.965139 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a334e6d8-b73e-4198-99a4-6405fab7078e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:09.971886 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-af28dea3-c79e-4c1a-855a-2091a97d701c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:09.972600 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-af28dea3-c79e-4c1a-855a-2091a97d701c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:09.973564 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-af28dea3-c79e-4c1a-855a-2091a97d701c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:09.974189 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-af28dea3-c79e-4c1a-855a-2091a97d701c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:10.152397 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a334e6d8-b73e-4198-99a4-6405fab7078e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:10.157617 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-af28dea3-c79e-4c1a-855a-2091a97d701c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:10.159577 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a334e6d8-b73e-4198-99a4-6405fab7078e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.210117 Oct 19 08:25:10.160148 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 106/217] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:09 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:10.167654 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-af28dea3-c79e-4c1a-855a-2091a97d701c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:10.169643 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-af28dea3-c79e-4c1a-855a-2091a97d701c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:10.170877 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-af28dea3-c79e-4c1a-855a-2091a97d701c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.211239 Oct 19 08:25:10.171429 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 112/218] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:25:09 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:25:10.190927 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-60f29fed-b290-40dd-afbf-4db0b0f28b15 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:10.191554 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-60f29fed-b290-40dd-afbf-4db0b0f28b15 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:10.197142 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-60f29fed-b290-40dd-afbf-4db0b0f28b15 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:10.197626 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-60f29fed-b290-40dd-afbf-4db0b0f28b15 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:10.198344 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-60f29fed-b290-40dd-afbf-4db0b0f28b15 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:10.198796 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-60f29fed-b290-40dd-afbf-4db0b0f28b15 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:10.204015 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8ede5724-f94d-4b9a-8880-6075e037b4a7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:10.204015 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-8ede5724-f94d-4b9a-8880-6075e037b4a7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:10.209268 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8ede5724-f94d-4b9a-8880-6075e037b4a7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:10.209713 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8ede5724-f94d-4b9a-8880-6075e037b4a7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:10.210475 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8ede5724-f94d-4b9a-8880-6075e037b4a7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:10.211055 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8ede5724-f94d-4b9a-8880-6075e037b4a7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:10.385947 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-60f29fed-b290-40dd-afbf-4db0b0f28b15 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:10.391563 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-8ede5724-f94d-4b9a-8880-6075e037b4a7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:10.393977 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-60f29fed-b290-40dd-afbf-4db0b0f28b15 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.206532 Oct 19 08:25:10.404543 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 107/219] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:10 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:10.412617 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-8961aac3-60ff-4c4c-8cd7-2b21db24cda4 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:10.413409 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-8961aac3-60ff-4c4c-8cd7-2b21db24cda4 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:10.413888 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-8ede5724-f94d-4b9a-8880-6075e037b4a7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.214936 Oct 19 08:25:10.414803 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 113/220] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:10 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:25:10.420461 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8961aac3-60ff-4c4c-8cd7-2b21db24cda4 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:10.420906 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8961aac3-60ff-4c4c-8cd7-2b21db24cda4 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:10.421670 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8961aac3-60ff-4c4c-8cd7-2b21db24cda4 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:10.422095 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8961aac3-60ff-4c4c-8cd7-2b21db24cda4 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:10.550455 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-8961aac3-60ff-4c4c-8cd7-2b21db24cda4 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:10.558182 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-8961aac3-60ff-4c4c-8cd7-2b21db24cda4 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.151912 Oct 19 08:25:10.558783 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 108/221] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:10 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:11.175915 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-ca0ebdcf-7687-4bba-9027-fb1b60696ba5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:11.176589 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-ca0ebdcf-7687-4bba-9027-fb1b60696ba5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:11.182246 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ca0ebdcf-7687-4bba-9027-fb1b60696ba5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:11.182723 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ca0ebdcf-7687-4bba-9027-fb1b60696ba5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:11.183657 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ca0ebdcf-7687-4bba-9027-fb1b60696ba5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:11.183900 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ca0ebdcf-7687-4bba-9027-fb1b60696ba5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:11.188548 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-80bb3071-6faf-48cd-9932-f1c5bb1fc098 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:11.189143 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-80bb3071-6faf-48cd-9932-f1c5bb1fc098 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:11.194837 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-80bb3071-6faf-48cd-9932-f1c5bb1fc098 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:11.195221 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-80bb3071-6faf-48cd-9932-f1c5bb1fc098 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:11.195977 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-80bb3071-6faf-48cd-9932-f1c5bb1fc098 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:11.196400 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-80bb3071-6faf-48cd-9932-f1c5bb1fc098 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:11.361013 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-ca0ebdcf-7687-4bba-9027-fb1b60696ba5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:11.369091 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-ca0ebdcf-7687-4bba-9027-fb1b60696ba5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.196745 Oct 19 08:25:11.369677 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-80bb3071-6faf-48cd-9932-f1c5bb1fc098 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:11.369842 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 114/222] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:11 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:11.383085 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-80bb3071-6faf-48cd-9932-f1c5bb1fc098 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:11.384855 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-80bb3071-6faf-48cd-9932-f1c5bb1fc098 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:11.385980 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-80bb3071-6faf-48cd-9932-f1c5bb1fc098 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.201165 Oct 19 08:25:11.386571 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 109/223] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:25:11 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:25:11.411065 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-b4057ac5-65ae-4a37-ac33-1e1d3f0f1540 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:11.411660 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-b4057ac5-65ae-4a37-ac33-1e1d3f0f1540 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:11.417196 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b4057ac5-65ae-4a37-ac33-1e1d3f0f1540 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:11.417634 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b4057ac5-65ae-4a37-ac33-1e1d3f0f1540 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:11.418369 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b4057ac5-65ae-4a37-ac33-1e1d3f0f1540 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:11.419515 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b4057ac5-65ae-4a37-ac33-1e1d3f0f1540 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:11.431111 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-8b444de6-d4fd-4846-aa16-fa97de2a54b5 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:11.431940 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-8b444de6-d4fd-4846-aa16-fa97de2a54b5 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:11.437968 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8b444de6-d4fd-4846-aa16-fa97de2a54b5 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:11.438413 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8b444de6-d4fd-4846-aa16-fa97de2a54b5 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:11.439355 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8b444de6-d4fd-4846-aa16-fa97de2a54b5 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:11.439962 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8b444de6-d4fd-4846-aa16-fa97de2a54b5 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:11.615852 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-b4057ac5-65ae-4a37-ac33-1e1d3f0f1540 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:11.620610 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-8b444de6-d4fd-4846-aa16-fa97de2a54b5 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:11.623815 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-b4057ac5-65ae-4a37-ac33-1e1d3f0f1540 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.216243 Oct 19 08:25:11.624382 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 115/224] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:11 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:11.629151 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8e1cd1c1-d175-4f8f-80d9-036e970af925 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:11.629975 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-8e1cd1c1-d175-4f8f-80d9-036e970af925 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:11.639151 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-8b444de6-d4fd-4846-aa16-fa97de2a54b5 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.210769 Oct 19 08:25:11.639151 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 110/225] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:11 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:25:11.642262 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8e1cd1c1-d175-4f8f-80d9-036e970af925 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:11.642817 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8e1cd1c1-d175-4f8f-80d9-036e970af925 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:11.643675 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8e1cd1c1-d175-4f8f-80d9-036e970af925 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:11.644025 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8e1cd1c1-d175-4f8f-80d9-036e970af925 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:11.763735 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-8e1cd1c1-d175-4f8f-80d9-036e970af925 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:11.770854 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-8e1cd1c1-d175-4f8f-80d9-036e970af925 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.145328 Oct 19 08:25:11.771472 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 116/226] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:11 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:12.386008 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e951bb49-9a56-41bb-9e0d-ede131d8acfd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:12.386641 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e951bb49-9a56-41bb-9e0d-ede131d8acfd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:12.392959 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e951bb49-9a56-41bb-9e0d-ede131d8acfd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:12.393406 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e951bb49-9a56-41bb-9e0d-ede131d8acfd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:12.394166 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e951bb49-9a56-41bb-9e0d-ede131d8acfd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:12.394622 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e951bb49-9a56-41bb-9e0d-ede131d8acfd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:12.404264 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-64897705-b360-43d3-8f21-2ee3336465ef tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:12.405482 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-64897705-b360-43d3-8f21-2ee3336465ef tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:12.413820 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-64897705-b360-43d3-8f21-2ee3336465ef tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:12.414351 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-64897705-b360-43d3-8f21-2ee3336465ef tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:12.415938 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-64897705-b360-43d3-8f21-2ee3336465ef tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:12.416434 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-64897705-b360-43d3-8f21-2ee3336465ef tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:12.604598 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-e951bb49-9a56-41bb-9e0d-ede131d8acfd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:12.609104 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-64897705-b360-43d3-8f21-2ee3336465ef tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:12.614411 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e951bb49-9a56-41bb-9e0d-ede131d8acfd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.231107 Oct 19 08:25:12.614411 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 111/227] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:12 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:12.619643 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-64897705-b360-43d3-8f21-2ee3336465ef tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:12.622199 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-64897705-b360-43d3-8f21-2ee3336465ef tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:12.623732 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-64897705-b360-43d3-8f21-2ee3336465ef tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.223690 Oct 19 08:25:12.624711 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 117/228] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:25:12 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:25:12.641725 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-29c7d962-d2b7-4b38-a72b-e4292c67d61c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:12.642329 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-29c7d962-d2b7-4b38-a72b-e4292c67d61c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:12.648793 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-29c7d962-d2b7-4b38-a72b-e4292c67d61c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:12.649341 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-29c7d962-d2b7-4b38-a72b-e4292c67d61c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:12.650215 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-29c7d962-d2b7-4b38-a72b-e4292c67d61c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:12.650662 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-29c7d962-d2b7-4b38-a72b-e4292c67d61c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:12.659994 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-613aaea7-9740-4a34-8a26-98817c83f615 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:12.660732 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-613aaea7-9740-4a34-8a26-98817c83f615 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:12.667420 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-613aaea7-9740-4a34-8a26-98817c83f615 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:12.667859 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-613aaea7-9740-4a34-8a26-98817c83f615 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:12.669396 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-613aaea7-9740-4a34-8a26-98817c83f615 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:12.669914 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-613aaea7-9740-4a34-8a26-98817c83f615 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:12.856826 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-29c7d962-d2b7-4b38-a72b-e4292c67d61c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:12.867999 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-29c7d962-d2b7-4b38-a72b-e4292c67d61c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1314 microversion: 2.1 time: 0.230295 Oct 19 08:25:12.868929 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 112/229] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:12 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:12.876122 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c5723a3a-6a03-4c63-92a2-d967904f9d8a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:12.877165 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c5723a3a-6a03-4c63-92a2-d967904f9d8a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:12.885896 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-613aaea7-9740-4a34-8a26-98817c83f615 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:12.886376 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c5723a3a-6a03-4c63-92a2-d967904f9d8a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:12.887427 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c5723a3a-6a03-4c63-92a2-d967904f9d8a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:12.888518 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c5723a3a-6a03-4c63-92a2-d967904f9d8a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:12.889172 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c5723a3a-6a03-4c63-92a2-d967904f9d8a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:12.893749 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-613aaea7-9740-4a34-8a26-98817c83f615 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.239805 Oct 19 08:25:12.903815 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 118/230] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:12 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:13.054517 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-c5723a3a-6a03-4c63-92a2-d967904f9d8a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:13.064522 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c5723a3a-6a03-4c63-92a2-d967904f9d8a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1317 microversion: 2.1 time: 0.194381 Oct 19 08:25:13.065773 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 113/231] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:12 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:13.516454 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-344f49b6-993f-4021-87c6-ac453ef9129f req-1107d9e6-8084-4967-b5ef-a9c81de59325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a856f6-f552-461f-8d9c-4bf017cbbac5", "name": "network-vif-plugged", "status": "completed", "tag": "f6a1d3b0-9ba8-4cd7-b18a-cd9b4d0b1082"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:13.519112 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:25:13.519112 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:25:13.527514 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-344f49b6-993f-4021-87c6-ac453ef9129f req-1107d9e6-8084-4967-b5ef-a9c81de59325 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:13.528518 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-344f49b6-993f-4021-87c6-ac453ef9129f req-1107d9e6-8084-4967-b5ef-a9c81de59325 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:13.540113 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-344f49b6-993f-4021-87c6-ac453ef9129f req-1107d9e6-8084-4967-b5ef-a9c81de59325 service nova] Creating event network-vif-plugged:f6a1d3b0-9ba8-4cd7-b18a-cd9b4d0b1082 for instance a2a856f6-f552-461f-8d9c-4bf017cbbac5 on hv-cinder-81398 Oct 19 08:25:13.546786 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-344f49b6-993f-4021-87c6-ac453ef9129f req-1107d9e6-8084-4967-b5ef-a9c81de59325 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035382 Oct 19 08:25:13.547886 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 119/232] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:25:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:25:13.631807 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-9a110341-f792-4ae6-9e61-937d619dacb5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:13.632384 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-9a110341-f792-4ae6-9e61-937d619dacb5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:13.643751 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-b8b96403-6ecf-4dc5-b1c3-173a457702bd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:13.644431 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-b8b96403-6ecf-4dc5-b1c3-173a457702bd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:13.649823 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9a110341-f792-4ae6-9e61-937d619dacb5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:13.650258 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9a110341-f792-4ae6-9e61-937d619dacb5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:13.651041 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9a110341-f792-4ae6-9e61-937d619dacb5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:13.655402 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b8b96403-6ecf-4dc5-b1c3-173a457702bd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:13.656132 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b8b96403-6ecf-4dc5-b1c3-173a457702bd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:13.656807 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9a110341-f792-4ae6-9e61-937d619dacb5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:13.657801 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b8b96403-6ecf-4dc5-b1c3-173a457702bd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:13.658220 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b8b96403-6ecf-4dc5-b1c3-173a457702bd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:13.961126 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-9a110341-f792-4ae6-9e61-937d619dacb5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:13.962020 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-b8b96403-6ecf-4dc5-b1c3-173a457702bd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:13.986758 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-9a110341-f792-4ae6-9e61-937d619dacb5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.358715 Oct 19 08:25:13.995431 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 114/233] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:13 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:13.997018 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-b8b96403-6ecf-4dc5-b1c3-173a457702bd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:13.999079 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-b8b96403-6ecf-4dc5-b1c3-173a457702bd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:14.003517 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-b8b96403-6ecf-4dc5-b1c3-173a457702bd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.363432 Oct 19 08:25:14.005046 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 120/234] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:25:13 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:25:14.008244 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-6d3b7046-97a6-4fae-a664-0787b98a3c31 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:14.009155 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-6d3b7046-97a6-4fae-a664-0787b98a3c31 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:14.016948 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c16574ff-afd7-41f8-bd04-37bd94a65088 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:14.018825 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-c16574ff-afd7-41f8-bd04-37bd94a65088 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:14.023918 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6d3b7046-97a6-4fae-a664-0787b98a3c31 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:14.028674 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6d3b7046-97a6-4fae-a664-0787b98a3c31 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:14.030051 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6d3b7046-97a6-4fae-a664-0787b98a3c31 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:14.031810 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c16574ff-afd7-41f8-bd04-37bd94a65088 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:14.032351 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6d3b7046-97a6-4fae-a664-0787b98a3c31 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:14.034662 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c16574ff-afd7-41f8-bd04-37bd94a65088 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:14.035650 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c16574ff-afd7-41f8-bd04-37bd94a65088 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:14.036297 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c16574ff-afd7-41f8-bd04-37bd94a65088 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:14.471699 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-6d3b7046-97a6-4fae-a664-0787b98a3c31 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:14.474107 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-c16574ff-afd7-41f8-bd04-37bd94a65088 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:14.483368 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-6d3b7046-97a6-4fae-a664-0787b98a3c31 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1502 microversion: 2.1 time: 0.486462 Oct 19 08:25:14.484002 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-c16574ff-afd7-41f8-bd04-37bd94a65088 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.475681 Oct 19 08:25:14.485325 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 115/236] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:13 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1502 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:14.485450 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 121/236] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:14 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:14.494799 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-541d3925-fb58-428a-a7e0-679122eda67b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:14.495534 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-541d3925-fb58-428a-a7e0-679122eda67b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:14.504481 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-541d3925-fb58-428a-a7e0-679122eda67b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:14.505176 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-541d3925-fb58-428a-a7e0-679122eda67b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:14.506674 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-541d3925-fb58-428a-a7e0-679122eda67b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:14.507355 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-541d3925-fb58-428a-a7e0-679122eda67b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:14.653538 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-541d3925-fb58-428a-a7e0-679122eda67b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:14.660996 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-541d3925-fb58-428a-a7e0-679122eda67b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1508 microversion: 2.1 time: 0.173294 Oct 19 08:25:14.661553 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 116/237] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:14 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:15.012402 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-9559197e-8763-4693-bac5-a49ad17fee2b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:15.013026 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-9559197e-8763-4693-bac5-a49ad17fee2b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:15.018610 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9559197e-8763-4693-bac5-a49ad17fee2b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:15.019043 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9559197e-8763-4693-bac5-a49ad17fee2b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:15.019795 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9559197e-8763-4693-bac5-a49ad17fee2b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:15.020224 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9559197e-8763-4693-bac5-a49ad17fee2b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:15.022818 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-327dd0df-2477-4b9e-ae06-a88fc0673edd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:15.023427 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-327dd0df-2477-4b9e-ae06-a88fc0673edd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:15.029953 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-327dd0df-2477-4b9e-ae06-a88fc0673edd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:15.030395 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-327dd0df-2477-4b9e-ae06-a88fc0673edd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:15.031185 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-327dd0df-2477-4b9e-ae06-a88fc0673edd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:15.031612 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-327dd0df-2477-4b9e-ae06-a88fc0673edd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:15.201206 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-9559197e-8763-4693-bac5-a49ad17fee2b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:15.210091 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-9559197e-8763-4693-bac5-a49ad17fee2b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.201226 Oct 19 08:25:15.210766 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 122/238] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:15 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:15.214818 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-327dd0df-2477-4b9e-ae06-a88fc0673edd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:15.224401 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-327dd0df-2477-4b9e-ae06-a88fc0673edd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:15.225886 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-327dd0df-2477-4b9e-ae06-a88fc0673edd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:15.227169 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-327dd0df-2477-4b9e-ae06-a88fc0673edd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.208045 Oct 19 08:25:15.227739 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 117/239] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:25:15 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:25:15.523485 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-7f336a33-27b5-402a-b91a-d33db7c83513 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:15.524082 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-7f336a33-27b5-402a-b91a-d33db7c83513 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:15.530635 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7f336a33-27b5-402a-b91a-d33db7c83513 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:15.531082 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7f336a33-27b5-402a-b91a-d33db7c83513 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:15.531840 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7f336a33-27b5-402a-b91a-d33db7c83513 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:15.532266 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7f336a33-27b5-402a-b91a-d33db7c83513 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:15.652347 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-7f336a33-27b5-402a-b91a-d33db7c83513 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:15.659983 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-7f336a33-27b5-402a-b91a-d33db7c83513 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.140042 Oct 19 08:25:15.660476 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 123/240] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:15 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:16.227392 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-7c8614ee-df5e-4a75-8338-a2000c452421 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:16.227925 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-7c8614ee-df5e-4a75-8338-a2000c452421 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:16.234329 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7c8614ee-df5e-4a75-8338-a2000c452421 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:16.234792 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7c8614ee-df5e-4a75-8338-a2000c452421 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:16.235541 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7c8614ee-df5e-4a75-8338-a2000c452421 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:16.235965 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7c8614ee-df5e-4a75-8338-a2000c452421 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:16.244753 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2ac1286e-76d2-4450-af41-2111fa281f43 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:16.245348 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2ac1286e-76d2-4450-af41-2111fa281f43 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:16.251977 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2ac1286e-76d2-4450-af41-2111fa281f43 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:16.252413 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2ac1286e-76d2-4450-af41-2111fa281f43 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:16.253418 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2ac1286e-76d2-4450-af41-2111fa281f43 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:16.253849 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2ac1286e-76d2-4450-af41-2111fa281f43 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:16.415776 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-7c8614ee-df5e-4a75-8338-a2000c452421 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:16.420281 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-2ac1286e-76d2-4450-af41-2111fa281f43 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:16.424436 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-7c8614ee-df5e-4a75-8338-a2000c452421 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.200647 Oct 19 08:25:16.425108 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 118/241] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:16 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:16.429398 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-2ac1286e-76d2-4450-af41-2111fa281f43 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:16.430918 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-2ac1286e-76d2-4450-af41-2111fa281f43 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:16.431997 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2ac1286e-76d2-4450-af41-2111fa281f43 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.190941 Oct 19 08:25:16.432534 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 124/242] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:25:16 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:25:16.676362 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ca798f89-3f64-4373-ab12-c78f510170a7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:16.676971 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ca798f89-3f64-4373-ab12-c78f510170a7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:16.682589 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ca798f89-3f64-4373-ab12-c78f510170a7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:16.683014 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ca798f89-3f64-4373-ab12-c78f510170a7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:16.683759 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ca798f89-3f64-4373-ab12-c78f510170a7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:16.684261 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ca798f89-3f64-4373-ab12-c78f510170a7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:16.801565 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ca798f89-3f64-4373-ab12-c78f510170a7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:16.808633 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ca798f89-3f64-4373-ab12-c78f510170a7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.135836 Oct 19 08:25:16.809345 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 119/243] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:16 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:17.440798 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-48b3f2e7-6d68-45b9-b605-11698334cc0c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:17.441389 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-48b3f2e7-6d68-45b9-b605-11698334cc0c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:17.447462 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-48b3f2e7-6d68-45b9-b605-11698334cc0c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:17.447897 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-48b3f2e7-6d68-45b9-b605-11698334cc0c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:17.448640 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-48b3f2e7-6d68-45b9-b605-11698334cc0c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:17.449056 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-48b3f2e7-6d68-45b9-b605-11698334cc0c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:17.450597 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b804ad09-9f66-4ce1-84da-617857845a50 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:17.451253 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b804ad09-9f66-4ce1-84da-617857845a50 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:17.456914 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b804ad09-9f66-4ce1-84da-617857845a50 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:17.457351 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b804ad09-9f66-4ce1-84da-617857845a50 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:17.458102 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b804ad09-9f66-4ce1-84da-617857845a50 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:17.458547 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b804ad09-9f66-4ce1-84da-617857845a50 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:17.671674 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-48b3f2e7-6d68-45b9-b605-11698334cc0c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:17.681459 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-48b3f2e7-6d68-45b9-b605-11698334cc0c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.244126 Oct 19 08:25:17.681672 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-b804ad09-9f66-4ce1-84da-617857845a50 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:17.682308 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 125/244] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:17 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:25:17.691129 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-b804ad09-9f66-4ce1-84da-617857845a50 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:17.692618 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-b804ad09-9f66-4ce1-84da-617857845a50 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:17.693749 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b804ad09-9f66-4ce1-84da-617857845a50 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.247571 Oct 19 08:25:17.694287 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 120/245] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:25:17 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:25:17.827429 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-a936f011-e854-4f6d-a7b1-e4afedbec451 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:17.828428 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-a936f011-e854-4f6d-a7b1-e4afedbec451 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:17.835431 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a936f011-e854-4f6d-a7b1-e4afedbec451 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:17.835872 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a936f011-e854-4f6d-a7b1-e4afedbec451 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:17.836628 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a936f011-e854-4f6d-a7b1-e4afedbec451 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:17.837093 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a936f011-e854-4f6d-a7b1-e4afedbec451 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:17.966609 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-a936f011-e854-4f6d-a7b1-e4afedbec451 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:17.974832 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-a936f011-e854-4f6d-a7b1-e4afedbec451 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.152689 Oct 19 08:25:17.975400 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 126/246] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:17 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:18.698572 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-80ba875b-2020-4192-aa55-e7a8b4f25fae tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:18.699168 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-80ba875b-2020-4192-aa55-e7a8b4f25fae tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:18.705623 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-80ba875b-2020-4192-aa55-e7a8b4f25fae tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:18.706076 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-80ba875b-2020-4192-aa55-e7a8b4f25fae tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:18.706907 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-80ba875b-2020-4192-aa55-e7a8b4f25fae tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:18.707327 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-80ba875b-2020-4192-aa55-e7a8b4f25fae tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:18.711423 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-f10354c7-6661-4861-840b-14b4e88fe8d6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:18.712042 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-f10354c7-6661-4861-840b-14b4e88fe8d6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:18.718372 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f10354c7-6661-4861-840b-14b4e88fe8d6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:18.718835 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f10354c7-6661-4861-840b-14b4e88fe8d6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:18.719581 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f10354c7-6661-4861-840b-14b4e88fe8d6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:18.720005 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f10354c7-6661-4861-840b-14b4e88fe8d6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:18.883418 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-80ba875b-2020-4192-aa55-e7a8b4f25fae tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:18.888353 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-f10354c7-6661-4861-840b-14b4e88fe8d6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:18.890767 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-80ba875b-2020-4192-aa55-e7a8b4f25fae tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.195679 Oct 19 08:25:18.891325 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 121/247] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:18 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:18.896529 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-f10354c7-6661-4861-840b-14b4e88fe8d6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:18.898087 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-f10354c7-6661-4861-840b-14b4e88fe8d6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:18.899229 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-f10354c7-6661-4861-840b-14b4e88fe8d6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.191397 Oct 19 08:25:18.899768 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 127/248] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:25:18 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:25:18.991874 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-702704bc-e049-44a8-b157-f3175106b574 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:18.992663 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-702704bc-e049-44a8-b157-f3175106b574 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:18.998783 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-702704bc-e049-44a8-b157-f3175106b574 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:18.999216 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-702704bc-e049-44a8-b157-f3175106b574 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:18.999989 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-702704bc-e049-44a8-b157-f3175106b574 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:19.000409 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-702704bc-e049-44a8-b157-f3175106b574 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:19.120419 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-702704bc-e049-44a8-b157-f3175106b574 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:19.127417 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-702704bc-e049-44a8-b157-f3175106b574 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.139446 Oct 19 08:25:19.128083 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 122/249] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:18 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:19.907454 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-bac282c4-14e4-474f-b3c9-d0838ff9c313 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:19.908064 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-bac282c4-14e4-474f-b3c9-d0838ff9c313 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:19.915314 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bac282c4-14e4-474f-b3c9-d0838ff9c313 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:19.915910 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bac282c4-14e4-474f-b3c9-d0838ff9c313 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:19.916690 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bac282c4-14e4-474f-b3c9-d0838ff9c313 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:19.917118 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bac282c4-14e4-474f-b3c9-d0838ff9c313 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:19.917343 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-fdd08919-fbe6-4125-b089-6b8f5484b83e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:19.918019 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-fdd08919-fbe6-4125-b089-6b8f5484b83e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:19.925988 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fdd08919-fbe6-4125-b089-6b8f5484b83e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:19.926520 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fdd08919-fbe6-4125-b089-6b8f5484b83e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:19.927278 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fdd08919-fbe6-4125-b089-6b8f5484b83e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:19.927702 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fdd08919-fbe6-4125-b089-6b8f5484b83e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:20.202015 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-fdd08919-fbe6-4125-b089-6b8f5484b83e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:20.206311 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-bac282c4-14e4-474f-b3c9-d0838ff9c313 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:20.210116 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-fdd08919-fbe6-4125-b089-6b8f5484b83e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:20.211790 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-fdd08919-fbe6-4125-b089-6b8f5484b83e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:20.212871 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-fdd08919-fbe6-4125-b089-6b8f5484b83e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.299407 Oct 19 08:25:20.213418 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 123/250] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:25:19 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:25:20.223321 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-bac282c4-14e4-474f-b3c9-d0838ff9c313 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.310374 Oct 19 08:25:20.223321 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 128/251] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:19 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:20.225862 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-12414918-410c-4624-b7c0-2ba55c653011 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:20.226466 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-12414918-410c-4624-b7c0-2ba55c653011 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:20.232079 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-12414918-410c-4624-b7c0-2ba55c653011 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:20.232516 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-12414918-410c-4624-b7c0-2ba55c653011 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:20.233450 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-12414918-410c-4624-b7c0-2ba55c653011 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:20.233876 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-12414918-410c-4624-b7c0-2ba55c653011 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:20.420876 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-12414918-410c-4624-b7c0-2ba55c653011 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:20.428181 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-12414918-410c-4624-b7c0-2ba55c653011 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.212358 Oct 19 08:25:20.428666 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 129/252] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:20 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:21.233127 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e2617ef5-6bbd-45ba-baff-17304fba0c88 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:21.233722 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e2617ef5-6bbd-45ba-baff-17304fba0c88 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:21.235579 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-a66d2b8c-7dc8-4329-aea8-1d6964da86ed tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:21.236183 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-a66d2b8c-7dc8-4329-aea8-1d6964da86ed tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:21.240042 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e2617ef5-6bbd-45ba-baff-17304fba0c88 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:21.240479 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e2617ef5-6bbd-45ba-baff-17304fba0c88 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:21.241417 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e2617ef5-6bbd-45ba-baff-17304fba0c88 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:21.241843 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e2617ef5-6bbd-45ba-baff-17304fba0c88 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:21.242147 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a66d2b8c-7dc8-4329-aea8-1d6964da86ed tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:21.242628 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a66d2b8c-7dc8-4329-aea8-1d6964da86ed tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:21.243448 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a66d2b8c-7dc8-4329-aea8-1d6964da86ed tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:21.243882 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a66d2b8c-7dc8-4329-aea8-1d6964da86ed tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:21.441156 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-a66d2b8c-7dc8-4329-aea8-1d6964da86ed tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:21.445612 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-e2617ef5-6bbd-45ba-baff-17304fba0c88 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:21.457495 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-a66d2b8c-7dc8-4329-aea8-1d6964da86ed tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.229024 Oct 19 08:25:21.458165 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 130/253] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:21 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:21.458526 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-e2617ef5-6bbd-45ba-baff-17304fba0c88 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:21.460345 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-e2617ef5-6bbd-45ba-baff-17304fba0c88 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:21.461701 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e2617ef5-6bbd-45ba-baff-17304fba0c88 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.233365 Oct 19 08:25:21.462468 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 124/254] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:25:21 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:25:21.470789 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-7d8a39ed-27ce-4d93-bd87-1dc6a6180285 req-0ad7d83b-1571-4445-a4c5-9661af212b72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7dae80-4592-45ea-a52d-05aa559c102a", "name": "network-vif-plugged", "status": "completed", "tag": "3ccfabb1-82b3-4904-a943-c29622e0b546"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:21.470789 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:25:21.470789 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:25:21.472837 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-7d8a39ed-27ce-4d93-bd87-1dc6a6180285 req-0ad7d83b-1571-4445-a4c5-9661af212b72 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:21.473268 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-7d8a39ed-27ce-4d93-bd87-1dc6a6180285 req-0ad7d83b-1571-4445-a4c5-9661af212b72 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:21.479702 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-16aafec9-0f93-4b38-b068-fb7abe271e57 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:21.480420 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-16aafec9-0f93-4b38-b068-fb7abe271e57 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:21.485652 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-7d8a39ed-27ce-4d93-bd87-1dc6a6180285 req-0ad7d83b-1571-4445-a4c5-9661af212b72 service nova] Creating event network-vif-plugged:3ccfabb1-82b3-4904-a943-c29622e0b546 for instance fe7dae80-4592-45ea-a52d-05aa559c102a on hv-cinder-81398 Oct 19 08:25:21.488425 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-16aafec9-0f93-4b38-b068-fb7abe271e57 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:21.488996 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-16aafec9-0f93-4b38-b068-fb7abe271e57 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:21.489986 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-16aafec9-0f93-4b38-b068-fb7abe271e57 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:21.490572 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-16aafec9-0f93-4b38-b068-fb7abe271e57 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:21.491141 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-7d8a39ed-27ce-4d93-bd87-1dc6a6180285 req-0ad7d83b-1571-4445-a4c5-9661af212b72 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031460 Oct 19 08:25:21.491834 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 131/255] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:25:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:25:21.613127 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-16aafec9-0f93-4b38-b068-fb7abe271e57 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:21.620167 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-16aafec9-0f93-4b38-b068-fb7abe271e57 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.147341 Oct 19 08:25:21.620660 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 125/256] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:21 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:22.475619 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-b110df27-7a19-487c-9c95-25d74df82a1d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:22.476313 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-b110df27-7a19-487c-9c95-25d74df82a1d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:22.482798 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3c561241-9777-40c3-8115-66d84f58b8f0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:22.483218 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b110df27-7a19-487c-9c95-25d74df82a1d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:22.483431 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3c561241-9777-40c3-8115-66d84f58b8f0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:22.483557 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b110df27-7a19-487c-9c95-25d74df82a1d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:22.484290 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b110df27-7a19-487c-9c95-25d74df82a1d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:22.484719 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b110df27-7a19-487c-9c95-25d74df82a1d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:22.489065 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3c561241-9777-40c3-8115-66d84f58b8f0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:22.489501 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3c561241-9777-40c3-8115-66d84f58b8f0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:22.490245 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3c561241-9777-40c3-8115-66d84f58b8f0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:22.490829 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3c561241-9777-40c3-8115-66d84f58b8f0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:22.658670 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-b110df27-7a19-487c-9c95-25d74df82a1d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:22.663114 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3c561241-9777-40c3-8115-66d84f58b8f0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:22.666037 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-b110df27-7a19-487c-9c95-25d74df82a1d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.194447 Oct 19 08:25:22.666636 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 132/257] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:22 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:22.671245 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-b2fc98c7-6b23-4f6e-8981-2816fbe4cebf tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:22.671397 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3c561241-9777-40c3-8115-66d84f58b8f0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:22.671836 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-b2fc98c7-6b23-4f6e-8981-2816fbe4cebf tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:22.673203 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3c561241-9777-40c3-8115-66d84f58b8f0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:22.674421 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3c561241-9777-40c3-8115-66d84f58b8f0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.195362 Oct 19 08:25:22.675213 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 126/258] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:25:22 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:25:22.677336 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b2fc98c7-6b23-4f6e-8981-2816fbe4cebf tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:22.677775 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b2fc98c7-6b23-4f6e-8981-2816fbe4cebf tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:22.678553 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b2fc98c7-6b23-4f6e-8981-2816fbe4cebf tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:22.678978 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b2fc98c7-6b23-4f6e-8981-2816fbe4cebf tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:22.795414 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-b2fc98c7-6b23-4f6e-8981-2816fbe4cebf tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:22.802499 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-b2fc98c7-6b23-4f6e-8981-2816fbe4cebf tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.134924 Oct 19 08:25:22.803058 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 133/259] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:22 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:23.508746 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-8752e119-3960-44aa-ac34-533ab83b7f5f req-f0842f51-c95f-4e5a-ae4a-d58430d955d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feb56f1c-831c-4725-b502-fbf7f6b9fe5b", "name": "network-vif-plugged", "status": "completed", "tag": "af354896-e292-4dc8-8c66-71861bbc0358"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:23.510350 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:25:23.510350 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:25:23.517092 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-8752e119-3960-44aa-ac34-533ab83b7f5f req-f0842f51-c95f-4e5a-ae4a-d58430d955d1 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:23.517515 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-8752e119-3960-44aa-ac34-533ab83b7f5f req-f0842f51-c95f-4e5a-ae4a-d58430d955d1 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:23.527737 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-8752e119-3960-44aa-ac34-533ab83b7f5f req-f0842f51-c95f-4e5a-ae4a-d58430d955d1 service nova] Creating event network-vif-plugged:af354896-e292-4dc8-8c66-71861bbc0358 for instance feb56f1c-831c-4725-b502-fbf7f6b9fe5b on hv-cinder-81398 Oct 19 08:25:23.532493 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-8752e119-3960-44aa-ac34-533ab83b7f5f req-f0842f51-c95f-4e5a-ae4a-d58430d955d1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027229 Oct 19 08:25:23.533037 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 127/260] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:25:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 08:25:23.682571 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-598d7ca8-ffba-41d9-a524-f871f87d5505 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:23.683164 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-598d7ca8-ffba-41d9-a524-f871f87d5505 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:23.689632 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-598d7ca8-ffba-41d9-a524-f871f87d5505 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:23.690064 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-598d7ca8-ffba-41d9-a524-f871f87d5505 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:23.690833 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-598d7ca8-ffba-41d9-a524-f871f87d5505 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:23.691251 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-598d7ca8-ffba-41d9-a524-f871f87d5505 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:23.692718 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-4318a3f8-50f8-4dd8-afde-546dac59debb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:23.693399 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-4318a3f8-50f8-4dd8-afde-546dac59debb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:23.699316 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4318a3f8-50f8-4dd8-afde-546dac59debb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:23.699808 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4318a3f8-50f8-4dd8-afde-546dac59debb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:23.700557 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4318a3f8-50f8-4dd8-afde-546dac59debb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:23.700981 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4318a3f8-50f8-4dd8-afde-546dac59debb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:23.865914 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-598d7ca8-ffba-41d9-a524-f871f87d5505 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:23.870672 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-4318a3f8-50f8-4dd8-afde-546dac59debb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:23.873383 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-598d7ca8-ffba-41d9-a524-f871f87d5505 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.194388 Oct 19 08:25:23.873947 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 134/261] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:23 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:23.878651 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-132ac5af-5ee4-4934-a144-cdb6b90e0e0a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:23.879428 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-132ac5af-5ee4-4934-a144-cdb6b90e0e0a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:23.880905 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-4318a3f8-50f8-4dd8-afde-546dac59debb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:23.882344 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-4318a3f8-50f8-4dd8-afde-546dac59debb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:23.883454 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-4318a3f8-50f8-4dd8-afde-546dac59debb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.194722 Oct 19 08:25:23.883993 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 128/262] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:25:23 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:25:23.885207 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-132ac5af-5ee4-4934-a144-cdb6b90e0e0a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:23.885687 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-132ac5af-5ee4-4934-a144-cdb6b90e0e0a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:23.886454 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-132ac5af-5ee4-4934-a144-cdb6b90e0e0a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:23.886898 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-132ac5af-5ee4-4934-a144-cdb6b90e0e0a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:24.007717 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-132ac5af-5ee4-4934-a144-cdb6b90e0e0a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:24.015038 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-132ac5af-5ee4-4934-a144-cdb6b90e0e0a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.139843 Oct 19 08:25:24.015604 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 135/263] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:23 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:24.889881 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-8af16da8-ff02-41df-a841-f309b14f2456 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:24.890572 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-8af16da8-ff02-41df-a841-f309b14f2456 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:24.896439 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8af16da8-ff02-41df-a841-f309b14f2456 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:24.896878 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8af16da8-ff02-41df-a841-f309b14f2456 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:24.897619 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8af16da8-ff02-41df-a841-f309b14f2456 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:24.898035 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8af16da8-ff02-41df-a841-f309b14f2456 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:24.900868 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-df5f80b6-ab27-41a3-8cbf-f574ff2d6e84 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:24.901463 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-df5f80b6-ab27-41a3-8cbf-f574ff2d6e84 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:24.907807 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-df5f80b6-ab27-41a3-8cbf-f574ff2d6e84 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:24.908240 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-df5f80b6-ab27-41a3-8cbf-f574ff2d6e84 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:24.908998 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-df5f80b6-ab27-41a3-8cbf-f574ff2d6e84 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:24.909424 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-df5f80b6-ab27-41a3-8cbf-f574ff2d6e84 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:25.080616 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-8af16da8-ff02-41df-a841-f309b14f2456 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:25.083508 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-df5f80b6-ab27-41a3-8cbf-f574ff2d6e84 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:25.087783 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-8af16da8-ff02-41df-a841-f309b14f2456 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.201526 Oct 19 08:25:25.088415 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 129/264] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:24 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:25.091892 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-df5f80b6-ab27-41a3-8cbf-f574ff2d6e84 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:25.093365 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-df5f80b6-ab27-41a3-8cbf-f574ff2d6e84 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:25.093819 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-835db6fe-b3a2-4732-83a4-9aaf47a8229d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:25.094406 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-835db6fe-b3a2-4732-83a4-9aaf47a8229d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:25.094536 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-df5f80b6-ab27-41a3-8cbf-f574ff2d6e84 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.197184 Oct 19 08:25:25.096751 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 136/265] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:25:24 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:25:25.100225 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-835db6fe-b3a2-4732-83a4-9aaf47a8229d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:25.100663 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-835db6fe-b3a2-4732-83a4-9aaf47a8229d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:25.101484 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-835db6fe-b3a2-4732-83a4-9aaf47a8229d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:25.101831 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-835db6fe-b3a2-4732-83a4-9aaf47a8229d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:25.221588 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-835db6fe-b3a2-4732-83a4-9aaf47a8229d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:25.228697 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-835db6fe-b3a2-4732-83a4-9aaf47a8229d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.139373 Oct 19 08:25:25.229245 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 130/266] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:25 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:25.549305 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-4acb655a-57fa-437c-ae61-e95e9594f613 req-6b43e224-a3c0-403a-bd71-06b65f353c2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b1ba9b-8d31-4658-9d03-3be46d4f7504", "name": "network-vif-plugged", "status": "completed", "tag": "dd3a33e9-9f8d-4c39-a3b8-617d066c9a63"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:25.551068 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:25:25.551068 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:25:25.557802 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-4acb655a-57fa-437c-ae61-e95e9594f613 req-6b43e224-a3c0-403a-bd71-06b65f353c2b service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:25.558235 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-4acb655a-57fa-437c-ae61-e95e9594f613 req-6b43e224-a3c0-403a-bd71-06b65f353c2b service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:25.569122 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-4acb655a-57fa-437c-ae61-e95e9594f613 req-6b43e224-a3c0-403a-bd71-06b65f353c2b service nova] Creating event network-vif-plugged:dd3a33e9-9f8d-4c39-a3b8-617d066c9a63 for instance 30b1ba9b-8d31-4658-9d03-3be46d4f7504 on hv-cinder-81398 Oct 19 08:25:25.573849 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-4acb655a-57fa-437c-ae61-e95e9594f613 req-6b43e224-a3c0-403a-bd71-06b65f353c2b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028251 Oct 19 08:25:25.574660 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 137/267] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:25:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 08:25:26.104836 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-8fe4e0cc-0f58-4b93-a230-4af2eeb87cfe tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:26.107179 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-8fe4e0cc-0f58-4b93-a230-4af2eeb87cfe tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:26.112163 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8fe4e0cc-0f58-4b93-a230-4af2eeb87cfe tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:26.112322 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-672847d6-4f6e-4614-a83d-ecafd0434e05 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:26.112751 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8fe4e0cc-0f58-4b93-a230-4af2eeb87cfe tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:26.112971 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-672847d6-4f6e-4614-a83d-ecafd0434e05 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:26.113341 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8fe4e0cc-0f58-4b93-a230-4af2eeb87cfe tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:26.113759 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8fe4e0cc-0f58-4b93-a230-4af2eeb87cfe tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:26.123270 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-672847d6-4f6e-4614-a83d-ecafd0434e05 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:26.124264 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-672847d6-4f6e-4614-a83d-ecafd0434e05 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:26.125393 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-672847d6-4f6e-4614-a83d-ecafd0434e05 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:26.126029 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-672847d6-4f6e-4614-a83d-ecafd0434e05 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:26.355502 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-8fe4e0cc-0f58-4b93-a230-4af2eeb87cfe tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:26.358283 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-672847d6-4f6e-4614-a83d-ecafd0434e05 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:26.363078 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-8fe4e0cc-0f58-4b93-a230-4af2eeb87cfe tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.261765 Oct 19 08:25:26.363636 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 131/268] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:26 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:26.365810 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-672847d6-4f6e-4614-a83d-ecafd0434e05 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:26.367336 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-672847d6-4f6e-4614-a83d-ecafd0434e05 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:26.368421 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-672847d6-4f6e-4614-a83d-ecafd0434e05 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.260077 Oct 19 08:25:26.369086 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 138/269] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:25:26 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:25:26.372409 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e99cd971-0e59-4ddf-a98c-bed90043920e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:26.374573 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e99cd971-0e59-4ddf-a98c-bed90043920e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:26.379126 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e99cd971-0e59-4ddf-a98c-bed90043920e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:26.379563 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e99cd971-0e59-4ddf-a98c-bed90043920e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:26.380314 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e99cd971-0e59-4ddf-a98c-bed90043920e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:26.380732 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e99cd971-0e59-4ddf-a98c-bed90043920e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:26.504440 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-e99cd971-0e59-4ddf-a98c-bed90043920e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:26.511583 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e99cd971-0e59-4ddf-a98c-bed90043920e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.143224 Oct 19 08:25:26.512751 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 132/270] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:26 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:27.383788 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-f74d84bf-7e72-4fc7-b23d-f6ab8eb4cb74 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:27.384579 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-f74d84bf-7e72-4fc7-b23d-f6ab8eb4cb74 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:27.386855 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3b94cae1-5421-432d-bc59-04c1f62927d3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:27.387800 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3b94cae1-5421-432d-bc59-04c1f62927d3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:27.390957 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f74d84bf-7e72-4fc7-b23d-f6ab8eb4cb74 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:27.391374 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f74d84bf-7e72-4fc7-b23d-f6ab8eb4cb74 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:27.392155 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f74d84bf-7e72-4fc7-b23d-f6ab8eb4cb74 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:27.392746 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f74d84bf-7e72-4fc7-b23d-f6ab8eb4cb74 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:27.394148 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3b94cae1-5421-432d-bc59-04c1f62927d3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:27.394630 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3b94cae1-5421-432d-bc59-04c1f62927d3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:27.395391 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3b94cae1-5421-432d-bc59-04c1f62927d3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:27.395819 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3b94cae1-5421-432d-bc59-04c1f62927d3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:27.585643 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3b94cae1-5421-432d-bc59-04c1f62927d3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:27.590136 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-f74d84bf-7e72-4fc7-b23d-f6ab8eb4cb74 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:27.594127 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3b94cae1-5421-432d-bc59-04c1f62927d3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:27.595650 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3b94cae1-5421-432d-bc59-04c1f62927d3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:27.596769 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3b94cae1-5421-432d-bc59-04c1f62927d3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.213644 Oct 19 08:25:27.597326 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 133/271] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:25:27 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:25:27.597839 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-f74d84bf-7e72-4fc7-b23d-f6ab8eb4cb74 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.218480 Oct 19 08:25:27.598430 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 139/272] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:27 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:27.601948 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-af6e0031-e02d-4331-9d65-3a43f7364996 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:27.602669 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-af6e0031-e02d-4331-9d65-3a43f7364996 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:27.609201 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-af6e0031-e02d-4331-9d65-3a43f7364996 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:27.609643 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-af6e0031-e02d-4331-9d65-3a43f7364996 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:27.610403 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-af6e0031-e02d-4331-9d65-3a43f7364996 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:27.610861 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-af6e0031-e02d-4331-9d65-3a43f7364996 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:27.726077 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-af6e0031-e02d-4331-9d65-3a43f7364996 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:27.734050 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-af6e0031-e02d-4331-9d65-3a43f7364996 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.135643 Oct 19 08:25:27.734629 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 134/273] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:27 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:28.485571 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-18d7162a-a050-4577-8dfc-898af9f47d21 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63b5b1c1-b1ed-49d7-af2d-9620339624eb"}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:28.486675 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-18d7162a-a050-4577-8dfc-898af9f47d21 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:28.492417 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-18d7162a-a050-4577-8dfc-898af9f47d21 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:28.492851 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-18d7162a-a050-4577-8dfc-898af9f47d21 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:28.493601 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-18d7162a-a050-4577-8dfc-898af9f47d21 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:28.494025 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-18d7162a-a050-4577-8dfc-898af9f47d21 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:28.558829 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-f5a2b1dd-5caf-42f3-9f32-bf208d4a11eb tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8bc2a98-753f-4f19-a59d-9c8a0b6ecd86"}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:28.560460 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-f5a2b1dd-5caf-42f3-9f32-bf208d4a11eb tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:28.566433 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f5a2b1dd-5caf-42f3-9f32-bf208d4a11eb tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:28.566906 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f5a2b1dd-5caf-42f3-9f32-bf208d4a11eb tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:28.567632 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f5a2b1dd-5caf-42f3-9f32-bf208d4a11eb tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:28.568055 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f5a2b1dd-5caf-42f3-9f32-bf208d4a11eb tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:28.855013 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-18d7162a-a050-4577-8dfc-898af9f47d21 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "POST /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.373234 Oct 19 08:25:28.855616 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 140/274] 10.222.0.26 () {60 vars in 1322 bytes} [Tue Oct 19 08:25:28 2021] POST /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1/os-volume_attachments => generated 194 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:25:28.861364 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-85c09137-590d-421d-a5fc-5e6a752e9c4a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:28.862042 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-85c09137-590d-421d-a5fc-5e6a752e9c4a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:28.868696 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-85c09137-590d-421d-a5fc-5e6a752e9c4a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:28.869140 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-85c09137-590d-421d-a5fc-5e6a752e9c4a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:28.870087 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-85c09137-590d-421d-a5fc-5e6a752e9c4a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:28.870529 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-85c09137-590d-421d-a5fc-5e6a752e9c4a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:28.959239 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-f5a2b1dd-5caf-42f3-9f32-bf208d4a11eb tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "POST /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.404089 Oct 19 08:25:28.959832 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 135/275] 10.222.0.26 () {60 vars in 1322 bytes} [Tue Oct 19 08:25:28 2021] POST /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f/os-volume_attachments => generated 194 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 08:25:28.965581 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-2ff6a7fb-4c2a-4b5c-9ab7-54523a0a3861 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:28.966553 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-2ff6a7fb-4c2a-4b5c-9ab7-54523a0a3861 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:28.974064 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2ff6a7fb-4c2a-4b5c-9ab7-54523a0a3861 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:28.974735 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2ff6a7fb-4c2a-4b5c-9ab7-54523a0a3861 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:28.975689 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2ff6a7fb-4c2a-4b5c-9ab7-54523a0a3861 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:28.976286 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2ff6a7fb-4c2a-4b5c-9ab7-54523a0a3861 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:29.006720 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-85c09137-590d-421d-a5fc-5e6a752e9c4a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:29.015180 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-85c09137-590d-421d-a5fc-5e6a752e9c4a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1362 microversion: 2.1 time: 0.158465 Oct 19 08:25:29.023795 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 141/276] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:28 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:29.023795 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-9fa755e2-758a-4eab-9e4d-f2e25198b3a3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:29.023795 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-9fa755e2-758a-4eab-9e4d-f2e25198b3a3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:29.026390 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9fa755e2-758a-4eab-9e4d-f2e25198b3a3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:29.026875 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9fa755e2-758a-4eab-9e4d-f2e25198b3a3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:29.027672 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9fa755e2-758a-4eab-9e4d-f2e25198b3a3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:29.028104 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9fa755e2-758a-4eab-9e4d-f2e25198b3a3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:29.166479 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-2ff6a7fb-4c2a-4b5c-9ab7-54523a0a3861 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:29.176118 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-2ff6a7fb-4c2a-4b5c-9ab7-54523a0a3861 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:29.177739 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-2ff6a7fb-4c2a-4b5c-9ab7-54523a0a3861 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:29.178864 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-2ff6a7fb-4c2a-4b5c-9ab7-54523a0a3861 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1407 microversion: 2.20 time: 0.217794 Oct 19 08:25:29.179720 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 136/277] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:25:28 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:25:29.216375 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-9fa755e2-758a-4eab-9e4d-f2e25198b3a3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:29.223867 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-9fa755e2-758a-4eab-9e4d-f2e25198b3a3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1322 microversion: 2.1 time: 0.207031 Oct 19 08:25:29.225425 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 142/278] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:29 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:30.032286 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-4390f6be-5393-4f4c-b8a8-b7f33b08b272 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:30.032816 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-4390f6be-5393-4f4c-b8a8-b7f33b08b272 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:30.039392 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4390f6be-5393-4f4c-b8a8-b7f33b08b272 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:30.039841 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4390f6be-5393-4f4c-b8a8-b7f33b08b272 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:30.040614 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4390f6be-5393-4f4c-b8a8-b7f33b08b272 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:30.041053 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4390f6be-5393-4f4c-b8a8-b7f33b08b272 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:30.165388 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-4390f6be-5393-4f4c-b8a8-b7f33b08b272 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:30.173021 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-4390f6be-5393-4f4c-b8a8-b7f33b08b272 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1547 microversion: 2.1 time: 0.144337 Oct 19 08:25:30.173713 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 137/279] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:30 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1547 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:30.191005 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-536568e2-ea4e-41f6-80b2-de673c171044 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:30.191507 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-536568e2-ea4e-41f6-80b2-de673c171044 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:30.197863 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-536568e2-ea4e-41f6-80b2-de673c171044 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:30.198298 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-536568e2-ea4e-41f6-80b2-de673c171044 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:30.198835 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a15431ef-fec9-4c9a-a291-6c11e69ad84b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:30.199141 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-536568e2-ea4e-41f6-80b2-de673c171044 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:30.199436 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a15431ef-fec9-4c9a-a291-6c11e69ad84b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:30.199569 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-536568e2-ea4e-41f6-80b2-de673c171044 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:30.206313 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a15431ef-fec9-4c9a-a291-6c11e69ad84b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:30.206822 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a15431ef-fec9-4c9a-a291-6c11e69ad84b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:30.207576 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a15431ef-fec9-4c9a-a291-6c11e69ad84b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:30.208004 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a15431ef-fec9-4c9a-a291-6c11e69ad84b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:30.307341 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-536568e2-ea4e-41f6-80b2-de673c171044 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.120263 Oct 19 08:25:30.307960 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 143/280] 10.222.0.26 () {58 vars in 1274 bytes} [Tue Oct 19 08:25:30 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:25:30.313010 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8937555c-e64d-4296-bc32-1c0748c8cb06 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:30.313610 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-8937555c-e64d-4296-bc32-1c0748c8cb06 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:30.319832 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8937555c-e64d-4296-bc32-1c0748c8cb06 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:30.320039 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8937555c-e64d-4296-bc32-1c0748c8cb06 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:30.320792 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8937555c-e64d-4296-bc32-1c0748c8cb06 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:30.321206 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8937555c-e64d-4296-bc32-1c0748c8cb06 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:30.371166 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a15431ef-fec9-4c9a-a291-6c11e69ad84b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:30.380376 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a15431ef-fec9-4c9a-a291-6c11e69ad84b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:30.382146 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a15431ef-fec9-4c9a-a291-6c11e69ad84b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:30.383307 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a15431ef-fec9-4c9a-a291-6c11e69ad84b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1600 microversion: 2.20 time: 0.188196 Oct 19 08:25:30.383854 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 138/281] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:25:30 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1600 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:25:30.401854 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e939c3ad-d993-414d-b5a1-4130a23785ad tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:30.402566 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e939c3ad-d993-414d-b5a1-4130a23785ad tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:30.408733 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e939c3ad-d993-414d-b5a1-4130a23785ad tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:30.409254 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e939c3ad-d993-414d-b5a1-4130a23785ad tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:30.410124 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e939c3ad-d993-414d-b5a1-4130a23785ad tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:30.410654 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e939c3ad-d993-414d-b5a1-4130a23785ad tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:30.484590 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-8937555c-e64d-4296-bc32-1c0748c8cb06 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:30.493710 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-8937555c-e64d-4296-bc32-1c0748c8cb06 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1516 microversion: 2.1 time: 0.184645 Oct 19 08:25:30.494301 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 144/282] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:30 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1516 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:30.511324 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-24633e5c-7db7-402d-b5d7-49f8343e1b84 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:30.512328 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-24633e5c-7db7-402d-b5d7-49f8343e1b84 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:30.512944 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e939c3ad-d993-414d-b5a1-4130a23785ad tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.115139 Oct 19 08:25:30.514204 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 139/283] 10.222.0.26 () {60 vars in 1315 bytes} [Tue Oct 19 08:25:30 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:25:30.518275 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-24633e5c-7db7-402d-b5d7-49f8343e1b84 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:30.518748 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-24633e5c-7db7-402d-b5d7-49f8343e1b84 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:30.519509 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-24633e5c-7db7-402d-b5d7-49f8343e1b84 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:30.520304 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-24633e5c-7db7-402d-b5d7-49f8343e1b84 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:30.546239 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.objects.instance [None req-24633e5c-7db7-402d-b5d7-49f8343e1b84 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lazy-loading 'flavor' on Instance uuid feb56f1c-831c-4725-b502-fbf7f6b9fe5b {{(pid=114105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 19 08:25:30.676495 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-24633e5c-7db7-402d-b5d7-49f8343e1b84 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "POST /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b/action" status: 200 len: 32 microversion: 2.1 time: 0.168730 Oct 19 08:25:30.677567 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 145/284] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:25:30 2021] POST /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b/action => generated 32 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 08:25:30.687220 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3f917ddf-1715-4dad-8ea2-4a5040d39dcb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:30.687823 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3f917ddf-1715-4dad-8ea2-4a5040d39dcb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:30.693704 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3f917ddf-1715-4dad-8ea2-4a5040d39dcb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:30.694367 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3f917ddf-1715-4dad-8ea2-4a5040d39dcb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:30.695318 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3f917ddf-1715-4dad-8ea2-4a5040d39dcb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:30.695894 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3f917ddf-1715-4dad-8ea2-4a5040d39dcb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:31.117694 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3f917ddf-1715-4dad-8ea2-4a5040d39dcb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:31.127238 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3f917ddf-1715-4dad-8ea2-4a5040d39dcb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.444703 Oct 19 08:25:31.128002 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 140/285] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:30 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:31.774140 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-570dda27-7186-4552-b2f9-0c0f82a8e3b9 req-08594529-1cfd-475a-94e0-d1d8199ab717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30b1ba9b-8d31-4658-9d03-3be46d4f7504", "tag": "dd3a33e9-9f8d-4c39-a3b8-617d066c9a63"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:31.778462 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-e17554e2-5591-4f9a-96dc-9665a3b99524 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:31.780499 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:25:31.780499 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:25:31.782126 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-e17554e2-5591-4f9a-96dc-9665a3b99524 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:31.791672 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-570dda27-7186-4552-b2f9-0c0f82a8e3b9 req-08594529-1cfd-475a-94e0-d1d8199ab717 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:31.792573 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-570dda27-7186-4552-b2f9-0c0f82a8e3b9 req-08594529-1cfd-475a-94e0-d1d8199ab717 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:31.795335 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e17554e2-5591-4f9a-96dc-9665a3b99524 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:31.795781 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e17554e2-5591-4f9a-96dc-9665a3b99524 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:31.797095 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e17554e2-5591-4f9a-96dc-9665a3b99524 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:31.797443 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e17554e2-5591-4f9a-96dc-9665a3b99524 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:31.808409 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-570dda27-7186-4552-b2f9-0c0f82a8e3b9 req-08594529-1cfd-475a-94e0-d1d8199ab717 service nova] Creating event network-changed:dd3a33e9-9f8d-4c39-a3b8-617d066c9a63 for instance 30b1ba9b-8d31-4658-9d03-3be46d4f7504 on hv-cinder-81398 Oct 19 08:25:31.814973 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-570dda27-7186-4552-b2f9-0c0f82a8e3b9 req-08594529-1cfd-475a-94e0-d1d8199ab717 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044507 Oct 19 08:25:31.815879 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 141/286] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:25:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:25:31.992590 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-02d43f6c-a04b-4eaa-b27f-2a43dc52dbe0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:31.993777 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-02d43f6c-a04b-4eaa-b27f-2a43dc52dbe0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:31.999966 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-02d43f6c-a04b-4eaa-b27f-2a43dc52dbe0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:32.000410 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-02d43f6c-a04b-4eaa-b27f-2a43dc52dbe0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:32.001351 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-02d43f6c-a04b-4eaa-b27f-2a43dc52dbe0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:32.001784 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-02d43f6c-a04b-4eaa-b27f-2a43dc52dbe0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:35.175956 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-02d43f6c-a04b-4eaa-b27f-2a43dc52dbe0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 14 microversion: 2.20 time: 3.187070 Oct 19 08:25:35.176585 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 142/287] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:25:31 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 14 bytes in 3189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:35.181526 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-a889f5bc-7aed-463e-908c-e7b2b4149805 req-2c4d1df4-17bc-4a43-b820-fc0b49c898e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe7dae80-4592-45ea-a52d-05aa559c102a", "tag": "3ccfabb1-82b3-4904-a943-c29622e0b546"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:35.182882 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-e17554e2-5591-4f9a-96dc-9665a3b99524 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 14 microversion: 2.1 time: 3.414323 Oct 19 08:25:35.183350 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:25:35.183350 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:25:35.183496 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 146/288] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:25:31 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 14 bytes in 3417 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 08:25:35.191589 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-7f9e9b14-f2d9-4cf0-90c1-f832cea21bb2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:35.192211 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-7f9e9b14-f2d9-4cf0-90c1-f832cea21bb2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:35.198014 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-a889f5bc-7aed-463e-908c-e7b2b4149805 req-2c4d1df4-17bc-4a43-b820-fc0b49c898e4 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:35.198461 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-a889f5bc-7aed-463e-908c-e7b2b4149805 req-2c4d1df4-17bc-4a43-b820-fc0b49c898e4 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:35.198598 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7f9e9b14-f2d9-4cf0-90c1-f832cea21bb2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:35.199055 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7f9e9b14-f2d9-4cf0-90c1-f832cea21bb2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:35.199875 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7f9e9b14-f2d9-4cf0-90c1-f832cea21bb2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:35.200338 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7f9e9b14-f2d9-4cf0-90c1-f832cea21bb2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:35.221763 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-a889f5bc-7aed-463e-908c-e7b2b4149805 req-2c4d1df4-17bc-4a43-b820-fc0b49c898e4 service nova] Creating event network-changed:3ccfabb1-82b3-4904-a943-c29622e0b546 for instance fe7dae80-4592-45ea-a52d-05aa559c102a on hv-cinder-81398 Oct 19 08:25:35.226814 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-a889f5bc-7aed-463e-908c-e7b2b4149805 req-2c4d1df4-17bc-4a43-b820-fc0b49c898e4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048981 Oct 19 08:25:35.227920 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 143/289] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:25:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:25:35.654569 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-7f9e9b14-f2d9-4cf0-90c1-f832cea21bb2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:35.661886 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-7f9e9b14-f2d9-4cf0-90c1-f832cea21bb2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.474373 Oct 19 08:25:35.662448 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 147/290] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:35 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:36.186762 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-6b70a59f-489c-4b06-bff0-a2db622e5011 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:36.187759 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-6b70a59f-489c-4b06-bff0-a2db622e5011 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:36.192900 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-e4ce1c2f-9f33-4ff1-adab-508427e05b9b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:36.194123 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-e4ce1c2f-9f33-4ff1-adab-508427e05b9b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:36.194357 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6b70a59f-489c-4b06-bff0-a2db622e5011 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:36.194857 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6b70a59f-489c-4b06-bff0-a2db622e5011 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:36.195592 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6b70a59f-489c-4b06-bff0-a2db622e5011 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:36.196015 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6b70a59f-489c-4b06-bff0-a2db622e5011 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:36.201215 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e4ce1c2f-9f33-4ff1-adab-508427e05b9b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:36.201986 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e4ce1c2f-9f33-4ff1-adab-508427e05b9b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:36.203028 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e4ce1c2f-9f33-4ff1-adab-508427e05b9b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:36.203679 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e4ce1c2f-9f33-4ff1-adab-508427e05b9b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:36.289953 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-6b70a59f-489c-4b06-bff0-a2db622e5011 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 14 microversion: 2.20 time: 0.107273 Oct 19 08:25:36.293736 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 144/291] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:25:36 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:36.428753 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-e4ce1c2f-9f33-4ff1-adab-508427e05b9b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 14 microversion: 2.1 time: 0.239168 Oct 19 08:25:36.429370 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 148/292] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:25:36 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 14 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 08:25:36.679741 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-adfcabd2-676a-422b-bae9-74ae64f079fe tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:36.680419 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-adfcabd2-676a-422b-bae9-74ae64f079fe tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:36.686894 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-adfcabd2-676a-422b-bae9-74ae64f079fe tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:36.687326 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-adfcabd2-676a-422b-bae9-74ae64f079fe tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:36.688069 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-adfcabd2-676a-422b-bae9-74ae64f079fe tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:36.688487 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-adfcabd2-676a-422b-bae9-74ae64f079fe tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:36.811317 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-adfcabd2-676a-422b-bae9-74ae64f079fe tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:36.818424 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-adfcabd2-676a-422b-bae9-74ae64f079fe tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.142739 Oct 19 08:25:36.818997 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 145/293] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:36 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:37.301656 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-6b7547b7-8207-40e9-ad8e-82692a1868a4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:37.302674 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-6b7547b7-8207-40e9-ad8e-82692a1868a4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:37.308948 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b7547b7-8207-40e9-ad8e-82692a1868a4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:37.309388 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b7547b7-8207-40e9-ad8e-82692a1868a4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:37.310758 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b7547b7-8207-40e9-ad8e-82692a1868a4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:37.311192 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b7547b7-8207-40e9-ad8e-82692a1868a4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:37.387647 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-6b7547b7-8207-40e9-ad8e-82692a1868a4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 14 microversion: 2.20 time: 0.089864 Oct 19 08:25:37.388303 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 149/294] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:25:37 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:37.439536 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-14ec0be4-22e9-46dc-be99-564c5da275b7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:37.440615 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-14ec0be4-22e9-46dc-be99-564c5da275b7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:37.446310 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-14ec0be4-22e9-46dc-be99-564c5da275b7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:37.446788 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-14ec0be4-22e9-46dc-be99-564c5da275b7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:37.447533 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-14ec0be4-22e9-46dc-be99-564c5da275b7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:37.448034 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-14ec0be4-22e9-46dc-be99-564c5da275b7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:37.522935 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-14ec0be4-22e9-46dc-be99-564c5da275b7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 14 microversion: 2.1 time: 0.086847 Oct 19 08:25:37.523609 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 146/295] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:25:37 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 08:25:37.836125 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2d71ae44-031b-4bf7-9472-4ee74b70081c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:37.836808 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2d71ae44-031b-4bf7-9472-4ee74b70081c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:37.846700 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2d71ae44-031b-4bf7-9472-4ee74b70081c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:37.847149 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2d71ae44-031b-4bf7-9472-4ee74b70081c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:37.847918 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2d71ae44-031b-4bf7-9472-4ee74b70081c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:37.848337 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2d71ae44-031b-4bf7-9472-4ee74b70081c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:37.976573 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-2d71ae44-031b-4bf7-9472-4ee74b70081c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:37.984745 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2d71ae44-031b-4bf7-9472-4ee74b70081c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.152514 Oct 19 08:25:37.985385 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 150/296] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:37 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:38.398688 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-375486ff-e111-4e66-9862-08caf0af2475 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:38.404754 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-375486ff-e111-4e66-9862-08caf0af2475 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:38.411701 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-375486ff-e111-4e66-9862-08caf0af2475 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:38.412139 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-375486ff-e111-4e66-9862-08caf0af2475 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:38.412891 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-375486ff-e111-4e66-9862-08caf0af2475 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:38.413480 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-375486ff-e111-4e66-9862-08caf0af2475 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:38.501378 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-375486ff-e111-4e66-9862-08caf0af2475 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 14 microversion: 2.20 time: 0.106421 Oct 19 08:25:38.502050 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 147/297] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:25:38 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:38.538390 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-1143b4ca-641c-4559-a799-9fecd3d3bc14 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:38.539213 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-1143b4ca-641c-4559-a799-9fecd3d3bc14 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:38.545657 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1143b4ca-641c-4559-a799-9fecd3d3bc14 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:38.546103 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1143b4ca-641c-4559-a799-9fecd3d3bc14 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:38.546899 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1143b4ca-641c-4559-a799-9fecd3d3bc14 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:38.547325 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1143b4ca-641c-4559-a799-9fecd3d3bc14 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:38.646588 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-1143b4ca-641c-4559-a799-9fecd3d3bc14 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 14 microversion: 2.1 time: 0.111856 Oct 19 08:25:38.649526 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 151/298] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:25:38 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 08:25:39.002243 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-be11b2b8-9fc8-4ca1-8ec4-abdd693bee93 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:39.002957 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-be11b2b8-9fc8-4ca1-8ec4-abdd693bee93 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:39.009520 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-be11b2b8-9fc8-4ca1-8ec4-abdd693bee93 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:39.009957 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-be11b2b8-9fc8-4ca1-8ec4-abdd693bee93 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:39.010748 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-be11b2b8-9fc8-4ca1-8ec4-abdd693bee93 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:39.011198 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-be11b2b8-9fc8-4ca1-8ec4-abdd693bee93 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:39.135860 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-be11b2b8-9fc8-4ca1-8ec4-abdd693bee93 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:39.143793 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-be11b2b8-9fc8-4ca1-8ec4-abdd693bee93 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.145482 Oct 19 08:25:39.144374 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 148/299] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:38 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:39.512645 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-19b8308e-a30f-4760-8c79-37cc5e061d96 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:39.513617 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-19b8308e-a30f-4760-8c79-37cc5e061d96 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:39.520496 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-19b8308e-a30f-4760-8c79-37cc5e061d96 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:39.520929 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-19b8308e-a30f-4760-8c79-37cc5e061d96 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:39.521757 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-19b8308e-a30f-4760-8c79-37cc5e061d96 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:39.522286 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-19b8308e-a30f-4760-8c79-37cc5e061d96 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:39.611271 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-19b8308e-a30f-4760-8c79-37cc5e061d96 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 14 microversion: 2.20 time: 0.102412 Oct 19 08:25:39.614456 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 152/300] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:25:39 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:39.657643 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-65f6295f-6d7c-4112-a087-a89f10ecd188 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:39.658574 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-65f6295f-6d7c-4112-a087-a89f10ecd188 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:39.664206 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-65f6295f-6d7c-4112-a087-a89f10ecd188 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:39.664837 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-65f6295f-6d7c-4112-a087-a89f10ecd188 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:39.665381 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-65f6295f-6d7c-4112-a087-a89f10ecd188 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:39.665801 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-65f6295f-6d7c-4112-a087-a89f10ecd188 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:39.741928 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-65f6295f-6d7c-4112-a087-a89f10ecd188 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 14 microversion: 2.1 time: 0.087996 Oct 19 08:25:39.745178 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 149/301] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:25:39 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 08:25:40.161282 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-f6bc18a6-7c2e-4046-9969-2883cc31903d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:40.161957 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-f6bc18a6-7c2e-4046-9969-2883cc31903d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:40.168240 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f6bc18a6-7c2e-4046-9969-2883cc31903d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:40.168676 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f6bc18a6-7c2e-4046-9969-2883cc31903d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:40.169419 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f6bc18a6-7c2e-4046-9969-2883cc31903d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:40.169890 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f6bc18a6-7c2e-4046-9969-2883cc31903d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:40.340130 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-f6bc18a6-7c2e-4046-9969-2883cc31903d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:40.348077 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-f6bc18a6-7c2e-4046-9969-2883cc31903d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.190699 Oct 19 08:25:40.348925 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 153/302] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:40 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:40.622452 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e990cd23-7d76-4070-a485-4719ac8bcfd6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:40.624636 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e990cd23-7d76-4070-a485-4719ac8bcfd6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:40.631246 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e990cd23-7d76-4070-a485-4719ac8bcfd6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:40.631694 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e990cd23-7d76-4070-a485-4719ac8bcfd6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:40.632459 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e990cd23-7d76-4070-a485-4719ac8bcfd6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:40.632884 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e990cd23-7d76-4070-a485-4719ac8bcfd6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:40.696211 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e990cd23-7d76-4070-a485-4719ac8bcfd6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 14 microversion: 2.20 time: 0.077498 Oct 19 08:25:40.699445 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 150/303] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:25:40 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:40.755967 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-6b2e3c44-8597-4a4f-865a-bde02c9f8389 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:40.756892 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-6b2e3c44-8597-4a4f-865a-bde02c9f8389 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:40.763527 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b2e3c44-8597-4a4f-865a-bde02c9f8389 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:40.764957 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b2e3c44-8597-4a4f-865a-bde02c9f8389 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:40.765835 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b2e3c44-8597-4a4f-865a-bde02c9f8389 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:40.766420 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b2e3c44-8597-4a4f-865a-bde02c9f8389 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:40.868018 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-6b2e3c44-8597-4a4f-865a-bde02c9f8389 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 14 microversion: 2.1 time: 0.118780 Oct 19 08:25:40.868940 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 154/304] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:25:40 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 08:25:41.365720 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-876ca731-7819-4e29-8c03-2fce1b19f65e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:41.366684 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-876ca731-7819-4e29-8c03-2fce1b19f65e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:41.373162 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-876ca731-7819-4e29-8c03-2fce1b19f65e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:41.373685 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-876ca731-7819-4e29-8c03-2fce1b19f65e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:41.374458 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-876ca731-7819-4e29-8c03-2fce1b19f65e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:41.374908 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-876ca731-7819-4e29-8c03-2fce1b19f65e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:41.522520 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-876ca731-7819-4e29-8c03-2fce1b19f65e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:41.532753 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-876ca731-7819-4e29-8c03-2fce1b19f65e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.170731 Oct 19 08:25:41.533340 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 151/305] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:41 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:41.708356 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-89b381a1-21ee-4e43-a53f-8bcb95aa3661 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:41.709361 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-89b381a1-21ee-4e43-a53f-8bcb95aa3661 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:41.716256 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-89b381a1-21ee-4e43-a53f-8bcb95aa3661 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:41.716747 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-89b381a1-21ee-4e43-a53f-8bcb95aa3661 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:41.718209 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-89b381a1-21ee-4e43-a53f-8bcb95aa3661 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:41.718672 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-89b381a1-21ee-4e43-a53f-8bcb95aa3661 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:41.809669 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-89b381a1-21ee-4e43-a53f-8bcb95aa3661 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 14 microversion: 2.20 time: 0.105161 Oct 19 08:25:41.810392 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 155/306] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:25:41 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:41.880056 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-d76425e2-bcf6-4d07-8591-bc268f064d6e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:41.881051 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-d76425e2-bcf6-4d07-8591-bc268f064d6e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:41.887327 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d76425e2-bcf6-4d07-8591-bc268f064d6e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:41.887802 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d76425e2-bcf6-4d07-8591-bc268f064d6e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:41.888587 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d76425e2-bcf6-4d07-8591-bc268f064d6e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:41.889056 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d76425e2-bcf6-4d07-8591-bc268f064d6e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:41.959681 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-d76425e2-bcf6-4d07-8591-bc268f064d6e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 14 microversion: 2.1 time: 0.083795 Oct 19 08:25:41.960305 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 152/307] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:25:41 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 08:25:42.552936 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-4dd1d03a-3555-4ae4-a9f3-a0420124514c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:42.553628 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-4dd1d03a-3555-4ae4-a9f3-a0420124514c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:42.560528 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4dd1d03a-3555-4ae4-a9f3-a0420124514c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:42.560995 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4dd1d03a-3555-4ae4-a9f3-a0420124514c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:42.561769 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4dd1d03a-3555-4ae4-a9f3-a0420124514c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:42.562194 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4dd1d03a-3555-4ae4-a9f3-a0420124514c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:42.696658 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-4dd1d03a-3555-4ae4-a9f3-a0420124514c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:42.703992 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-4dd1d03a-3555-4ae4-a9f3-a0420124514c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.155035 Oct 19 08:25:42.704717 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 156/308] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:42 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:42.820606 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-d3f7209e-95a3-4b18-b945-ec25613214ec tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:42.821689 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-d3f7209e-95a3-4b18-b945-ec25613214ec tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:42.829459 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d3f7209e-95a3-4b18-b945-ec25613214ec tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:42.829865 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d3f7209e-95a3-4b18-b945-ec25613214ec tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:42.830786 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d3f7209e-95a3-4b18-b945-ec25613214ec tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:42.831281 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d3f7209e-95a3-4b18-b945-ec25613214ec tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:42.902567 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-d3f7209e-95a3-4b18-b945-ec25613214ec tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 14 microversion: 2.20 time: 0.085823 Oct 19 08:25:42.903183 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 153/309] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:25:42 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:42.970360 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c6aecdc6-e01f-4000-9ad4-bd4c8194e1fd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:42.971359 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-c6aecdc6-e01f-4000-9ad4-bd4c8194e1fd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:42.977662 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c6aecdc6-e01f-4000-9ad4-bd4c8194e1fd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:42.978116 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c6aecdc6-e01f-4000-9ad4-bd4c8194e1fd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:42.979479 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c6aecdc6-e01f-4000-9ad4-bd4c8194e1fd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:42.980057 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c6aecdc6-e01f-4000-9ad4-bd4c8194e1fd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:43.090648 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-c6aecdc6-e01f-4000-9ad4-bd4c8194e1fd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 14 microversion: 2.1 time: 0.123625 Oct 19 08:25:43.094444 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 157/310] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:25:42 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 08:25:43.723399 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-d16656cc-842d-49cf-b951-4d8dc55f5d78 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:43.724104 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-d16656cc-842d-49cf-b951-4d8dc55f5d78 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:43.730581 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d16656cc-842d-49cf-b951-4d8dc55f5d78 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:43.731495 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d16656cc-842d-49cf-b951-4d8dc55f5d78 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:43.732372 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d16656cc-842d-49cf-b951-4d8dc55f5d78 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:43.733518 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d16656cc-842d-49cf-b951-4d8dc55f5d78 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:43.866773 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-d16656cc-842d-49cf-b951-4d8dc55f5d78 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:43.874894 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-d16656cc-842d-49cf-b951-4d8dc55f5d78 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.157768 Oct 19 08:25:43.875449 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 154/311] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:43 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:43.913707 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-0e07460e-98fb-40f1-9d1c-2967d5eab471 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:43.914746 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-0e07460e-98fb-40f1-9d1c-2967d5eab471 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:43.921764 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0e07460e-98fb-40f1-9d1c-2967d5eab471 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:43.922271 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0e07460e-98fb-40f1-9d1c-2967d5eab471 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:43.923143 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0e07460e-98fb-40f1-9d1c-2967d5eab471 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:43.923568 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0e07460e-98fb-40f1-9d1c-2967d5eab471 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:44.025300 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-0e07460e-98fb-40f1-9d1c-2967d5eab471 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 14 microversion: 2.20 time: 0.115666 Oct 19 08:25:44.025935 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 158/312] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:25:43 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:44.101168 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b81926b1-16c9-40e9-8984-68f34e228fa3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:44.102075 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b81926b1-16c9-40e9-8984-68f34e228fa3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:44.107877 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b81926b1-16c9-40e9-8984-68f34e228fa3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:44.108887 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b81926b1-16c9-40e9-8984-68f34e228fa3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:44.109851 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b81926b1-16c9-40e9-8984-68f34e228fa3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:44.110279 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b81926b1-16c9-40e9-8984-68f34e228fa3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:44.183831 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b81926b1-16c9-40e9-8984-68f34e228fa3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 14 microversion: 2.1 time: 0.086147 Oct 19 08:25:44.184487 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 155/313] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:25:44 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 08:25:44.895467 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-0439b372-5c4e-4d78-bbb8-344de74b19d7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:44.896514 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-0439b372-5c4e-4d78-bbb8-344de74b19d7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:44.905513 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0439b372-5c4e-4d78-bbb8-344de74b19d7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:44.906203 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0439b372-5c4e-4d78-bbb8-344de74b19d7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:44.907560 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0439b372-5c4e-4d78-bbb8-344de74b19d7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:44.908412 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0439b372-5c4e-4d78-bbb8-344de74b19d7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:45.037528 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-09df0fb3-18e0-4a27-869f-2c48dddcb125 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:45.038612 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-09df0fb3-18e0-4a27-869f-2c48dddcb125 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:45.046755 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-09df0fb3-18e0-4a27-869f-2c48dddcb125 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:45.047205 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-09df0fb3-18e0-4a27-869f-2c48dddcb125 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:45.048037 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-09df0fb3-18e0-4a27-869f-2c48dddcb125 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:45.048477 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-09df0fb3-18e0-4a27-869f-2c48dddcb125 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:45.125741 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-09df0fb3-18e0-4a27-869f-2c48dddcb125 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 14 microversion: 2.20 time: 0.092555 Oct 19 08:25:45.126369 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 156/314] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:25:45 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:45.160206 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-0439b372-5c4e-4d78-bbb8-344de74b19d7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:45.169301 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-0439b372-5c4e-4d78-bbb8-344de74b19d7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.280712 Oct 19 08:25:45.170239 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 159/315] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:44 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:45.196175 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-72e9baab-c847-456e-9cd7-9101c1bbe155 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:45.197642 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-72e9baab-c847-456e-9cd7-9101c1bbe155 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:45.213021 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-72e9baab-c847-456e-9cd7-9101c1bbe155 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:45.213644 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-72e9baab-c847-456e-9cd7-9101c1bbe155 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:45.216887 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-72e9baab-c847-456e-9cd7-9101c1bbe155 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:45.217952 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-72e9baab-c847-456e-9cd7-9101c1bbe155 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:45.307600 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-72e9baab-c847-456e-9cd7-9101c1bbe155 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 14 microversion: 2.1 time: 0.116271 Oct 19 08:25:45.312659 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 157/316] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:25:45 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 08:25:45.894734 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-fd2f9893-4ac6-4fcc-9cf3-d394d6d23715 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:45.895345 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-fd2f9893-4ac6-4fcc-9cf3-d394d6d23715 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:45.902982 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fd2f9893-4ac6-4fcc-9cf3-d394d6d23715 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:45.903429 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fd2f9893-4ac6-4fcc-9cf3-d394d6d23715 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:45.904256 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fd2f9893-4ac6-4fcc-9cf3-d394d6d23715 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:45.905407 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fd2f9893-4ac6-4fcc-9cf3-d394d6d23715 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:45.940561 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-fd2f9893-4ac6-4fcc-9cf3-d394d6d23715 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Going to try to terminate instance {{(pid=114105) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 19 08:25:46.031003 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-fd2f9893-4ac6-4fcc-9cf3-d394d6d23715 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "DELETE /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 204 len: 0 microversion: 2.1 time: 0.141347 Oct 19 08:25:46.034389 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 160/317] 10.222.0.26 () {58 vars in 1238 bytes} [Tue Oct 19 08:25:45 2021] DELETE /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 08:25:46.042373 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-69b5b788-a82c-40d0-a77d-f08888afa935 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:46.043141 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-69b5b788-a82c-40d0-a77d-f08888afa935 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:46.050395 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-69b5b788-a82c-40d0-a77d-f08888afa935 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:46.051142 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-69b5b788-a82c-40d0-a77d-f08888afa935 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:46.052077 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-69b5b788-a82c-40d0-a77d-f08888afa935 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:46.052500 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-69b5b788-a82c-40d0-a77d-f08888afa935 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:46.137296 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-82ad068e-4e92-45ab-8863-c538b9959e63 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:46.138637 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-82ad068e-4e92-45ab-8863-c538b9959e63 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:46.148080 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-82ad068e-4e92-45ab-8863-c538b9959e63 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:46.148531 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-82ad068e-4e92-45ab-8863-c538b9959e63 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:46.149324 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-82ad068e-4e92-45ab-8863-c538b9959e63 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:46.149926 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-82ad068e-4e92-45ab-8863-c538b9959e63 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:46.194750 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-69b5b788-a82c-40d0-a77d-f08888afa935 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:46.203581 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-69b5b788-a82c-40d0-a77d-f08888afa935 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1554 microversion: 2.1 time: 0.166845 Oct 19 08:25:46.204646 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 158/318] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:46 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:46.209587 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a3844a61-480b-4547-8e77-7f5d1427046a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:46.210361 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a3844a61-480b-4547-8e77-7f5d1427046a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:46.216172 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a3844a61-480b-4547-8e77-7f5d1427046a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:46.216796 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a3844a61-480b-4547-8e77-7f5d1427046a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:46.218289 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a3844a61-480b-4547-8e77-7f5d1427046a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:46.219039 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a3844a61-480b-4547-8e77-7f5d1427046a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:46.252315 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-82ad068e-4e92-45ab-8863-c538b9959e63 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 14 microversion: 2.20 time: 0.118889 Oct 19 08:25:46.253058 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 161/319] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:25:46 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:25:46.320664 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-3349125c-708b-4695-824f-546cf07c32a2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:46.321936 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-3349125c-708b-4695-824f-546cf07c32a2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:46.328744 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3349125c-708b-4695-824f-546cf07c32a2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:46.329413 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3349125c-708b-4695-824f-546cf07c32a2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:46.330337 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3349125c-708b-4695-824f-546cf07c32a2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:46.330940 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3349125c-708b-4695-824f-546cf07c32a2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:46.358841 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a3844a61-480b-4547-8e77-7f5d1427046a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:46.372096 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a3844a61-480b-4547-8e77-7f5d1427046a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.164428 Oct 19 08:25:46.372096 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 159/320] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:46 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:46.434224 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-3349125c-708b-4695-824f-546cf07c32a2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 14 microversion: 2.1 time: 0.117252 Oct 19 08:25:46.435278 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 162/321] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:25:46 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 08:25:47.220971 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-f5aa89e3-e345-49d4-84e8-80f6d10d3e3c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:47.221728 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-f5aa89e3-e345-49d4-84e8-80f6d10d3e3c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:47.228553 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f5aa89e3-e345-49d4-84e8-80f6d10d3e3c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:47.229321 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f5aa89e3-e345-49d4-84e8-80f6d10d3e3c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:47.230307 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f5aa89e3-e345-49d4-84e8-80f6d10d3e3c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:47.230870 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f5aa89e3-e345-49d4-84e8-80f6d10d3e3c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:47.263808 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-3efcea9a-dd70-4ade-b7af-0cc1ebd9d726 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:47.265464 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-3efcea9a-dd70-4ade-b7af-0cc1ebd9d726 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:47.276492 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3efcea9a-dd70-4ade-b7af-0cc1ebd9d726 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:47.277131 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3efcea9a-dd70-4ade-b7af-0cc1ebd9d726 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:47.277942 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3efcea9a-dd70-4ade-b7af-0cc1ebd9d726 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:47.278588 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3efcea9a-dd70-4ade-b7af-0cc1ebd9d726 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:47.353886 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-3efcea9a-dd70-4ade-b7af-0cc1ebd9d726 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 14 microversion: 2.20 time: 0.094090 Oct 19 08:25:47.354609 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 163/322] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:25:47 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:25:47.389318 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-bcb308a4-01a5-4639-baad-a50860b0e8c1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:47.390013 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-bcb308a4-01a5-4639-baad-a50860b0e8c1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:47.408040 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bcb308a4-01a5-4639-baad-a50860b0e8c1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:47.415778 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bcb308a4-01a5-4639-baad-a50860b0e8c1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:47.416903 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bcb308a4-01a5-4639-baad-a50860b0e8c1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:47.417603 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bcb308a4-01a5-4639-baad-a50860b0e8c1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:47.419945 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-f5aa89e3-e345-49d4-84e8-80f6d10d3e3c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:47.428844 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-f5aa89e3-e345-49d4-84e8-80f6d10d3e3c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1554 microversion: 2.1 time: 0.211687 Oct 19 08:25:47.429410 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 160/323] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:47 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1554 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:47.445270 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-86bfcfbf-9e38-4133-a8f4-c2f821daa0d9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:47.446176 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-86bfcfbf-9e38-4133-a8f4-c2f821daa0d9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:47.462580 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-86bfcfbf-9e38-4133-a8f4-c2f821daa0d9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:47.463047 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-86bfcfbf-9e38-4133-a8f4-c2f821daa0d9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:47.463844 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-86bfcfbf-9e38-4133-a8f4-c2f821daa0d9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:47.464278 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-86bfcfbf-9e38-4133-a8f4-c2f821daa0d9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:47.576969 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-86bfcfbf-9e38-4133-a8f4-c2f821daa0d9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 14 microversion: 2.1 time: 0.134953 Oct 19 08:25:47.578096 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 161/324] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:25:47 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 08:25:47.724826 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-bcb308a4-01a5-4639-baad-a50860b0e8c1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:47.732366 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-bcb308a4-01a5-4639-baad-a50860b0e8c1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.346979 Oct 19 08:25:47.733479 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 164/325] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:47 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:25:48.365394 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-62e595d3-acf9-429b-87f1-0aed0bb10e90 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:48.366519 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-62e595d3-acf9-429b-87f1-0aed0bb10e90 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:48.372961 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-62e595d3-acf9-429b-87f1-0aed0bb10e90 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:48.373526 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-62e595d3-acf9-429b-87f1-0aed0bb10e90 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:48.374468 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-62e595d3-acf9-429b-87f1-0aed0bb10e90 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:48.375092 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-62e595d3-acf9-429b-87f1-0aed0bb10e90 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:48.446261 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-19ce4899-d8bf-47c9-978c-4d3ee1551754 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:48.447022 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-19ce4899-d8bf-47c9-978c-4d3ee1551754 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:48.454704 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-19ce4899-d8bf-47c9-978c-4d3ee1551754 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:48.455134 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-19ce4899-d8bf-47c9-978c-4d3ee1551754 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:48.455903 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-19ce4899-d8bf-47c9-978c-4d3ee1551754 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:48.456337 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-19ce4899-d8bf-47c9-978c-4d3ee1551754 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:48.490601 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-62e595d3-acf9-429b-87f1-0aed0bb10e90 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 6451 microversion: 2.20 time: 0.128992 Oct 19 08:25:48.491233 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 162/326] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:25:48 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 6451 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:25:48.588149 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-1f4a8afb-6b40-443d-b36b-572be2cb7c95 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:48.589576 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-1f4a8afb-6b40-443d-b36b-572be2cb7c95 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:48.598937 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1f4a8afb-6b40-443d-b36b-572be2cb7c95 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:48.599412 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1f4a8afb-6b40-443d-b36b-572be2cb7c95 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:48.600493 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1f4a8afb-6b40-443d-b36b-572be2cb7c95 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:48.600995 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1f4a8afb-6b40-443d-b36b-572be2cb7c95 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:48.614582 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-19ce4899-d8bf-47c9-978c-4d3ee1551754 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:48.622980 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-19ce4899-d8bf-47c9-978c-4d3ee1551754 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1554 microversion: 2.1 time: 0.180485 Oct 19 08:25:48.624380 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 165/327] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:48 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:25:48.749896 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-42bbb890-c33e-442d-8ab8-39ac0787ffe4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:48.750551 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-42bbb890-c33e-442d-8ab8-39ac0787ffe4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:48.756640 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-42bbb890-c33e-442d-8ab8-39ac0787ffe4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:48.757296 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-42bbb890-c33e-442d-8ab8-39ac0787ffe4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:48.758295 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-42bbb890-c33e-442d-8ab8-39ac0787ffe4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:48.758866 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-42bbb890-c33e-442d-8ab8-39ac0787ffe4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:48.784804 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-1f4a8afb-6b40-443d-b36b-572be2cb7c95 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 6451 microversion: 2.1 time: 0.199732 Oct 19 08:25:48.785524 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 163/328] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:25:48 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 6451 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:25:48.909112 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-42bbb890-c33e-442d-8ab8-39ac0787ffe4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:48.916564 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-42bbb890-c33e-442d-8ab8-39ac0787ffe4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.171072 Oct 19 08:25:48.917133 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 166/329] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:48 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:25:49.503171 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b82606c8-39ae-4427-8d16-447eec301b3a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:49.504619 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b82606c8-39ae-4427-8d16-447eec301b3a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:49.511149 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b82606c8-39ae-4427-8d16-447eec301b3a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:49.511586 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b82606c8-39ae-4427-8d16-447eec301b3a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:49.512336 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b82606c8-39ae-4427-8d16-447eec301b3a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:49.512754 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b82606c8-39ae-4427-8d16-447eec301b3a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:49.611658 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b82606c8-39ae-4427-8d16-447eec301b3a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 9954 microversion: 2.20 time: 0.112401 Oct 19 08:25:49.612515 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 164/330] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:25:49 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 9954 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:25:49.641827 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-7070ab27-ac78-4495-8c5b-8f4579bd6a27 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:49.642459 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-7070ab27-ac78-4495-8c5b-8f4579bd6a27 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:49.653485 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7070ab27-ac78-4495-8c5b-8f4579bd6a27 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:49.654027 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7070ab27-ac78-4495-8c5b-8f4579bd6a27 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:49.655413 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7070ab27-ac78-4495-8c5b-8f4579bd6a27 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:49.655848 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7070ab27-ac78-4495-8c5b-8f4579bd6a27 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:49.746751 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-eb34504c-260a-4378-a280-ad2f2bbc7739 req-7b0ecc30-c040-47af-8903-e80d452085e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59dbc4e4-8c02-40ac-92be-01a7d58a97a1", "name": "network-vif-deleted", "tag": "cbb46daa-64d5-4b7d-a375-36a1a97d0bb6"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:49.748299 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:25:49.748299 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:25:49.758441 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-7070ab27-ac78-4495-8c5b-8f4579bd6a27 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:49.762138 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-eb34504c-260a-4378-a280-ad2f2bbc7739 req-7b0ecc30-c040-47af-8903-e80d452085e2 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:49.762624 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-eb34504c-260a-4378-a280-ad2f2bbc7739 req-7b0ecc30-c040-47af-8903-e80d452085e2 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:49.773339 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-7070ab27-ac78-4495-8c5b-8f4579bd6a27 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1512 microversion: 2.1 time: 0.136309 Oct 19 08:25:49.774229 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 167/331] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:49 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1512 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:49.776629 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-eb34504c-260a-4378-a280-ad2f2bbc7739 req-7b0ecc30-c040-47af-8903-e80d452085e2 service nova] Creating event network-vif-deleted:cbb46daa-64d5-4b7d-a375-36a1a97d0bb6 for instance 59dbc4e4-8c02-40ac-92be-01a7d58a97a1 on hv-cinder-81398 Oct 19 08:25:49.783001 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-eb34504c-260a-4378-a280-ad2f2bbc7739 req-7b0ecc30-c040-47af-8903-e80d452085e2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040645 Oct 19 08:25:49.784156 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 165/332] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:25:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:25:49.796305 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-6f56f141-736e-4ecf-a9d4-3c81e56dedad tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:49.797184 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-6f56f141-736e-4ecf-a9d4-3c81e56dedad tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:49.804825 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6f56f141-736e-4ecf-a9d4-3c81e56dedad tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:49.805759 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6f56f141-736e-4ecf-a9d4-3c81e56dedad tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:49.807061 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6f56f141-736e-4ecf-a9d4-3c81e56dedad tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:49.807660 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6f56f141-736e-4ecf-a9d4-3c81e56dedad tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:49.900582 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-6f56f141-736e-4ecf-a9d4-3c81e56dedad tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 10009 microversion: 2.1 time: 0.108835 Oct 19 08:25:49.901580 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 168/333] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:25:49 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 10009 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:25:49.935852 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-f1a9c362-6a55-4e48-9169-02b0538ada51 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:49.936711 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-f1a9c362-6a55-4e48-9169-02b0538ada51 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:49.942703 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f1a9c362-6a55-4e48-9169-02b0538ada51 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:49.943132 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f1a9c362-6a55-4e48-9169-02b0538ada51 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:49.943883 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f1a9c362-6a55-4e48-9169-02b0538ada51 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:49.944310 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f1a9c362-6a55-4e48-9169-02b0538ada51 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:50.294526 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-f1a9c362-6a55-4e48-9169-02b0538ada51 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:50.302970 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-f1a9c362-6a55-4e48-9169-02b0538ada51 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.370886 Oct 19 08:25:50.303930 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 166/334] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:49 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:50.624292 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-22f22f60-9b50-4344-af16-e0a4b77bb396 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:50.625721 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-22f22f60-9b50-4344-af16-e0a4b77bb396 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:50.633013 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-22f22f60-9b50-4344-af16-e0a4b77bb396 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:50.633523 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-22f22f60-9b50-4344-af16-e0a4b77bb396 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:50.634359 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-22f22f60-9b50-4344-af16-e0a4b77bb396 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:50.635032 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-22f22f60-9b50-4344-af16-e0a4b77bb396 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:50.740089 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-22f22f60-9b50-4344-af16-e0a4b77bb396 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 13887 microversion: 2.20 time: 0.119304 Oct 19 08:25:50.743953 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 169/335] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:25:50 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 13887 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:25:50.790803 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-f8a8d8c6-44bc-4651-9dd3-aa53b172ea4e tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:50.792010 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-f8a8d8c6-44bc-4651-9dd3-aa53b172ea4e tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:50.800334 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f8a8d8c6-44bc-4651-9dd3-aa53b172ea4e tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:50.801117 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f8a8d8c6-44bc-4651-9dd3-aa53b172ea4e tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:50.802197 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f8a8d8c6-44bc-4651-9dd3-aa53b172ea4e tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:50.802858 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f8a8d8c6-44bc-4651-9dd3-aa53b172ea4e tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:50.837312 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f8a8d8c6-44bc-4651-9dd3-aa53b172ea4e tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:50.837976 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f8a8d8c6-44bc-4651-9dd3-aa53b172ea4e tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:50.838675 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.objects.instance [None req-f8a8d8c6-44bc-4651-9dd3-aa53b172ea4e tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lazy-loading 'fault' on Instance uuid 59dbc4e4-8c02-40ac-92be-01a7d58a97a1 {{(pid=114106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 19 08:25:50.888670 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-f8a8d8c6-44bc-4651-9dd3-aa53b172ea4e tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5933523d36e048269aaaa34dd1fd5c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28699d0a84f047ef8e686a6a7d0035fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:50.896715 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-f8a8d8c6-44bc-4651-9dd3-aa53b172ea4e tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 200 len: 1350 microversion: 2.1 time: 0.109408 Oct 19 08:25:50.914632 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 167/336] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:50 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 1350 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:50.915212 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-b00e3a95-fe94-4ede-aa8b-174cd542be31 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:50.916220 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-b00e3a95-fe94-4ede-aa8b-174cd542be31 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:50.925944 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b00e3a95-fe94-4ede-aa8b-174cd542be31 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:50.926388 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b00e3a95-fe94-4ede-aa8b-174cd542be31 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:50.927197 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b00e3a95-fe94-4ede-aa8b-174cd542be31 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:50.927629 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b00e3a95-fe94-4ede-aa8b-174cd542be31 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:51.025859 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-b00e3a95-fe94-4ede-aa8b-174cd542be31 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 14047 microversion: 2.1 time: 0.114937 Oct 19 08:25:51.026511 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 170/337] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:25:50 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 14047 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:25:51.320951 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-eb95f793-1e80-4ec9-9b1d-8c53b9ba736b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:51.321646 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-eb95f793-1e80-4ec9-9b1d-8c53b9ba736b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:51.328420 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-eb95f793-1e80-4ec9-9b1d-8c53b9ba736b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:51.328950 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-eb95f793-1e80-4ec9-9b1d-8c53b9ba736b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:51.329786 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-eb95f793-1e80-4ec9-9b1d-8c53b9ba736b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:51.330216 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-eb95f793-1e80-4ec9-9b1d-8c53b9ba736b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:51.464916 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-eb95f793-1e80-4ec9-9b1d-8c53b9ba736b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:51.472432 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-eb95f793-1e80-4ec9-9b1d-8c53b9ba736b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.155150 Oct 19 08:25:51.473265 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 168/338] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:51 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:51.751638 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-50509bf3-e8f4-4aaf-ac29-31cc462242d7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:51.752655 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-50509bf3-e8f4-4aaf-ac29-31cc462242d7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:51.759208 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-50509bf3-e8f4-4aaf-ac29-31cc462242d7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:51.759661 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-50509bf3-e8f4-4aaf-ac29-31cc462242d7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:51.760476 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-50509bf3-e8f4-4aaf-ac29-31cc462242d7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:51.760905 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-50509bf3-e8f4-4aaf-ac29-31cc462242d7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:51.915146 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3d4ab30a-4cee-4c02-b6e4-531d6f129f11 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:51.915658 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3d4ab30a-4cee-4c02-b6e4-531d6f129f11 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:51.922115 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3d4ab30a-4cee-4c02-b6e4-531d6f129f11 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:51.922578 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3d4ab30a-4cee-4c02-b6e4-531d6f129f11 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:51.923337 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3d4ab30a-4cee-4c02-b6e4-531d6f129f11 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:51.923760 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3d4ab30a-4cee-4c02-b6e4-531d6f129f11 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:51.938038 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.wsgi [None req-3d4ab30a-4cee-4c02-b6e4-531d6f129f11 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] HTTP exception thrown: Instance 59dbc4e4-8c02-40ac-92be-01a7d58a97a1 could not be found. Oct 19 08:25:51.938912 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3d4ab30a-4cee-4c02-b6e4-531d6f129f11 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Returning 404 to user: Instance 59dbc4e4-8c02-40ac-92be-01a7d58a97a1 could not be found. {{(pid=114106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:25:51.939705 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3d4ab30a-4cee-4c02-b6e4-531d6f129f11 tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 404 len: 111 microversion: 2.1 time: 0.028246 Oct 19 08:25:51.940360 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 169/339] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:51 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 08:25:51.960901 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-50509bf3-e8f4-4aaf-ac29-31cc462242d7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 16782 microversion: 2.20 time: 0.213694 Oct 19 08:25:51.961710 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 171/340] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:25:51 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 16782 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:25:52.046092 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b5efee83-c179-4e45-abe9-7ca578d5769f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:52.047311 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-566d4d96-b432-4cca-8fd6-54b503dc903c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:52.049651 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-566d4d96-b432-4cca-8fd6-54b503dc903c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:52.051288 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b5efee83-c179-4e45-abe9-7ca578d5769f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:52.063709 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b5efee83-c179-4e45-abe9-7ca578d5769f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:52.064768 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-566d4d96-b432-4cca-8fd6-54b503dc903c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:52.066298 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b5efee83-c179-4e45-abe9-7ca578d5769f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:52.066869 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-566d4d96-b432-4cca-8fd6-54b503dc903c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:52.068006 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b5efee83-c179-4e45-abe9-7ca578d5769f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:52.068441 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b5efee83-c179-4e45-abe9-7ca578d5769f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:52.071795 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-566d4d96-b432-4cca-8fd6-54b503dc903c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:52.072856 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-566d4d96-b432-4cca-8fd6-54b503dc903c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:52.102333 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.wsgi [None req-566d4d96-b432-4cca-8fd6-54b503dc903c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] HTTP exception thrown: Instance 59dbc4e4-8c02-40ac-92be-01a7d58a97a1 could not be found. Oct 19 08:25:52.102333 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-566d4d96-b432-4cca-8fd6-54b503dc903c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Returning 404 to user: Instance 59dbc4e4-8c02-40ac-92be-01a7d58a97a1 could not be found. {{(pid=114105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:25:52.102333 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-566d4d96-b432-4cca-8fd6-54b503dc903c tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.061912 Oct 19 08:25:52.102333 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 172/341] 10.222.0.26 () {58 vars in 1301 bytes} [Tue Oct 19 08:25:52 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1/os-volume_attachments => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 08:25:52.177954 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b5efee83-c179-4e45-abe9-7ca578d5769f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 16877 microversion: 2.1 time: 0.142588 Oct 19 08:25:52.182313 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 170/342] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:25:52 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 16877 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:25:52.489686 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-f65c424b-f80b-4beb-b7e9-ae0f09748758 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:52.490355 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-f65c424b-f80b-4beb-b7e9-ae0f09748758 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:52.497220 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f65c424b-f80b-4beb-b7e9-ae0f09748758 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:52.497873 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f65c424b-f80b-4beb-b7e9-ae0f09748758 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:52.498828 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f65c424b-f80b-4beb-b7e9-ae0f09748758 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:52.499368 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f65c424b-f80b-4beb-b7e9-ae0f09748758 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:52.658541 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-f65c424b-f80b-4beb-b7e9-ae0f09748758 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:52.672293 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-f65c424b-f80b-4beb-b7e9-ae0f09748758 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.186437 Oct 19 08:25:52.673183 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 173/343] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:52 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:52.973868 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-f4b3411c-fc5a-4c94-9d0c-c3fd819ed749 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:52.975475 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-f4b3411c-fc5a-4c94-9d0c-c3fd819ed749 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:52.981794 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f4b3411c-fc5a-4c94-9d0c-c3fd819ed749 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:52.982410 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f4b3411c-fc5a-4c94-9d0c-c3fd819ed749 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:52.983419 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f4b3411c-fc5a-4c94-9d0c-c3fd819ed749 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:52.983844 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f4b3411c-fc5a-4c94-9d0c-c3fd819ed749 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:53.089282 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-f4b3411c-fc5a-4c94-9d0c-c3fd819ed749 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 17808 microversion: 2.20 time: 0.119219 Oct 19 08:25:53.089924 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 171/344] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:25:52 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 17808 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:25:53.191063 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-40323f01-0ff5-4eb1-9021-351880fcc170 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:53.192277 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-40323f01-0ff5-4eb1-9021-351880fcc170 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:53.200050 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-40323f01-0ff5-4eb1-9021-351880fcc170 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:53.200569 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-40323f01-0ff5-4eb1-9021-351880fcc170 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:53.201469 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-40323f01-0ff5-4eb1-9021-351880fcc170 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:53.202085 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-40323f01-0ff5-4eb1-9021-351880fcc170 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:53.287130 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-40323f01-0ff5-4eb1-9021-351880fcc170 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 17629 microversion: 2.1 time: 0.101418 Oct 19 08:25:53.290989 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 174/345] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:25:53 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 17629 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:25:53.329390 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-d29ea70d-e7ab-4ee9-898a-e1ba16fda77d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:53.330223 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-d29ea70d-e7ab-4ee9-898a-e1ba16fda77d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:53.337065 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d29ea70d-e7ab-4ee9-898a-e1ba16fda77d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:53.337519 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d29ea70d-e7ab-4ee9-898a-e1ba16fda77d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:53.338299 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d29ea70d-e7ab-4ee9-898a-e1ba16fda77d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:53.338851 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d29ea70d-e7ab-4ee9-898a-e1ba16fda77d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:53.354113 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.wsgi [None req-d29ea70d-e7ab-4ee9-898a-e1ba16fda77d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] HTTP exception thrown: Instance 59dbc4e4-8c02-40ac-92be-01a7d58a97a1 could not be found. Oct 19 08:25:53.354768 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-d29ea70d-e7ab-4ee9-898a-e1ba16fda77d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Returning 404 to user: Instance 59dbc4e4-8c02-40ac-92be-01a7d58a97a1 could not be found. {{(pid=114106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:25:53.355586 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-d29ea70d-e7ab-4ee9-898a-e1ba16fda77d tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "DELETE /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 404 len: 111 microversion: 2.1 time: 0.030575 Oct 19 08:25:53.356218 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 172/346] 10.222.0.26 () {58 vars in 1238 bytes} [Tue Oct 19 08:25:53 2021] DELETE /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:25:53.364992 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-ad13faba-3a68-4dec-b830-b066afbc10cf tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:53.365689 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-ad13faba-3a68-4dec-b830-b066afbc10cf tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] [instance: 59dbc4e4-8c02-40ac-92be-01a7d58a97a1] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:53.372421 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ad13faba-3a68-4dec-b830-b066afbc10cf tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:53.372867 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ad13faba-3a68-4dec-b830-b066afbc10cf tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:53.374189 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ad13faba-3a68-4dec-b830-b066afbc10cf tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:53.374669 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ad13faba-3a68-4dec-b830-b066afbc10cf tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:53.390638 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.wsgi [None req-ad13faba-3a68-4dec-b830-b066afbc10cf tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] HTTP exception thrown: Instance 59dbc4e4-8c02-40ac-92be-01a7d58a97a1 could not be found. Oct 19 08:25:53.391232 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-ad13faba-3a68-4dec-b830-b066afbc10cf tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] Returning 404 to user: Instance 59dbc4e4-8c02-40ac-92be-01a7d58a97a1 could not be found. {{(pid=114105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:25:53.392082 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-ad13faba-3a68-4dec-b830-b066afbc10cf tempest-DeleteServersTestJSON-1462178114 tempest-DeleteServersTestJSON-1462178114-project] 10.222.0.26 "GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1" status: 404 len: 111 microversion: 2.1 time: 0.031262 Oct 19 08:25:53.392846 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 175/347] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:53 2021] GET /compute/v2.1/servers/59dbc4e4-8c02-40ac-92be-01a7d58a97a1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:25:53.690546 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-27f95acb-70db-4ab4-a1eb-e9ba0534084d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:53.690904 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-27f95acb-70db-4ab4-a1eb-e9ba0534084d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:53.700672 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-27f95acb-70db-4ab4-a1eb-e9ba0534084d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:53.702461 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-27f95acb-70db-4ab4-a1eb-e9ba0534084d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:53.705810 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-27f95acb-70db-4ab4-a1eb-e9ba0534084d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:53.706826 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-27f95acb-70db-4ab4-a1eb-e9ba0534084d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:53.747745 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-bc8b4d8b-468b-43bb-a1f6-b062bdc2f94c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1081833925", "imageRef": "9102a998-a580-4b4e-b6a1-3172273dd66d", "flavorRef": "452", "networks": [{"uuid": "fbed0243-7d71-4fc4-9caf-afbd08f9b31f"}]}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:53.835203 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.network.neutron [None req-bc8b4d8b-468b-43bb-a1f6-b062bdc2f94c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] validate_networks() for [('fbed0243-7d71-4fc4-9caf-afbd08f9b31f', None, None, None, None, None)] {{(pid=114105) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 19 08:25:53.985579 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-27f95acb-70db-4ab4-a1eb-e9ba0534084d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:53.993521 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-27f95acb-70db-4ab4-a1eb-e9ba0534084d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.307776 Oct 19 08:25:53.994643 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 173/348] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:53 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:54.101232 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-de7f152c-dfee-4f6e-afdb-1c5d72aabf8b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:54.102145 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-de7f152c-dfee-4f6e-afdb-1c5d72aabf8b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:54.108445 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-de7f152c-dfee-4f6e-afdb-1c5d72aabf8b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:54.108880 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-de7f152c-dfee-4f6e-afdb-1c5d72aabf8b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:54.109991 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-de7f152c-dfee-4f6e-afdb-1c5d72aabf8b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:54.110514 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-de7f152c-dfee-4f6e-afdb-1c5d72aabf8b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:54.208048 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-de7f152c-dfee-4f6e-afdb-1c5d72aabf8b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 19342 microversion: 2.20 time: 0.110175 Oct 19 08:25:54.208607 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 174/349] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:25:54 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 19342 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:25:54.295876 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-bc8b4d8b-468b-43bb-a1f6-b062bdc2f94c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Flavor limits 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 08:25:54.296830 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-bc8b4d8b-468b-43bb-a1f6-b062bdc2f94c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Image limits 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 08:25:54.297641 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-bc8b4d8b-468b-43bb-a1f6-b062bdc2f94c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Flavor pref 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 08:25:54.298279 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-bc8b4d8b-468b-43bb-a1f6-b062bdc2f94c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Image pref 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 08:25:54.298902 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-bc8b4d8b-468b-43bb-a1f6-b062bdc2f94c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 08:25:54.299290 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b1b178fa-1ee9-4bbe-8a6f-1d235b9337d8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:54.300284 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b1b178fa-1ee9-4bbe-8a6f-1d235b9337d8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:54.307719 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b1b178fa-1ee9-4bbe-8a6f-1d235b9337d8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:54.308387 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b1b178fa-1ee9-4bbe-8a6f-1d235b9337d8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:54.309174 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b1b178fa-1ee9-4bbe-8a6f-1d235b9337d8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:54.309601 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b1b178fa-1ee9-4bbe-8a6f-1d235b9337d8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:54.313174 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bc8b4d8b-468b-43bb-a1f6-b062bdc2f94c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:54.315706 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bc8b4d8b-468b-43bb-a1f6-b062bdc2f94c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:54.316570 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bc8b4d8b-468b-43bb-a1f6-b062bdc2f94c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:54.317371 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bc8b4d8b-468b-43bb-a1f6-b062bdc2f94c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:54.341149 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-bc8b4d8b-468b-43bb-a1f6-b062bdc2f94c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Getting quotas for project d1e6b0972cf140649ed2cad14f2db0b4. Resources: {'cores', 'instances', 'ram'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:25:54.346905 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-bc8b4d8b-468b-43bb-a1f6-b062bdc2f94c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Getting quotas for user bb3db95dc956487ead5e579b58451580 and project d1e6b0972cf140649ed2cad14f2db0b4. Resources: {'cores', 'instances', 'ram'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:25:54.360508 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-bc8b4d8b-468b-43bb-a1f6-b062bdc2f94c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Going to run 1 instances... {{(pid=114105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 19 08:25:54.363249 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-bc8b4d8b-468b-43bb-a1f6-b062bdc2f94c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 4bd61122-7096-461a-95b1-adc1dea18a0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9102a998-a580-4b4e-b6a1-3172273dd66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 19 08:25:54.403140 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b1b178fa-1ee9-4bbe-8a6f-1d235b9337d8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 19342 microversion: 2.1 time: 0.107866 Oct 19 08:25:54.403774 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 175/350] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:25:54 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 19342 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:25:54.428884 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-bc8b4d8b-468b-43bb-a1f6-b062bdc2f94c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.685421 Oct 19 08:25:54.431072 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 176/351] 10.222.0.26 () {60 vars in 1146 bytes} [Tue Oct 19 08:25:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 08:25:54.440335 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ac874abf-2dac-47df-957e-6cc53bb4860b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:54.441049 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ac874abf-2dac-47df-957e-6cc53bb4860b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 4bd61122-7096-461a-95b1-adc1dea18a0c] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:54.542608 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ac874abf-2dac-47df-957e-6cc53bb4860b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:54.549575 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ac874abf-2dac-47df-957e-6cc53bb4860b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c" status: 200 len: 1218 microversion: 2.1 time: 0.113408 Oct 19 08:25:54.551206 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 176/352] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:54 2021] GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:55.012054 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-246de6c4-0e0c-4a32-9923-b3f3dd8ef922 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:55.012659 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-246de6c4-0e0c-4a32-9923-b3f3dd8ef922 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:55.021239 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-246de6c4-0e0c-4a32-9923-b3f3dd8ef922 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:55.021676 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-246de6c4-0e0c-4a32-9923-b3f3dd8ef922 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:55.022455 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-246de6c4-0e0c-4a32-9923-b3f3dd8ef922 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:55.025910 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-246de6c4-0e0c-4a32-9923-b3f3dd8ef922 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:55.222965 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-4b0ed8ba-9f34-4958-acd0-5a6e162674e0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:55.225049 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-4b0ed8ba-9f34-4958-acd0-5a6e162674e0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:55.235038 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4b0ed8ba-9f34-4958-acd0-5a6e162674e0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:55.235440 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4b0ed8ba-9f34-4958-acd0-5a6e162674e0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:55.236198 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4b0ed8ba-9f34-4958-acd0-5a6e162674e0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:55.236832 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4b0ed8ba-9f34-4958-acd0-5a6e162674e0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:55.285299 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-246de6c4-0e0c-4a32-9923-b3f3dd8ef922 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:55.295224 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-246de6c4-0e0c-4a32-9923-b3f3dd8ef922 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.287009 Oct 19 08:25:55.297057 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 177/353] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:55 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:55.333986 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-4b0ed8ba-9f34-4958-acd0-5a6e162674e0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 21703 microversion: 2.20 time: 0.116690 Oct 19 08:25:55.334971 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 177/354] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:25:55 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 21703 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:25:55.415118 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-a2f04f49-8f6d-4525-acae-6eaae5dc5489 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:55.416125 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-a2f04f49-8f6d-4525-acae-6eaae5dc5489 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:55.430165 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a2f04f49-8f6d-4525-acae-6eaae5dc5489 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:55.430648 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a2f04f49-8f6d-4525-acae-6eaae5dc5489 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:55.431425 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a2f04f49-8f6d-4525-acae-6eaae5dc5489 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:55.431854 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a2f04f49-8f6d-4525-acae-6eaae5dc5489 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:55.524735 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-a2f04f49-8f6d-4525-acae-6eaae5dc5489 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 21338 microversion: 2.1 time: 0.112322 Oct 19 08:25:55.526032 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 178/355] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:25:55 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 21338 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:25:55.568446 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-23e99ced-af4c-4aaf-941e-f7653032f3d0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:55.569450 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-23e99ced-af4c-4aaf-941e-f7653032f3d0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 4bd61122-7096-461a-95b1-adc1dea18a0c] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:55.575855 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-23e99ced-af4c-4aaf-941e-f7653032f3d0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:55.577394 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-23e99ced-af4c-4aaf-941e-f7653032f3d0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:55.578567 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-23e99ced-af4c-4aaf-941e-f7653032f3d0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:55.579161 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-23e99ced-af4c-4aaf-941e-f7653032f3d0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:55.675102 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-23e99ced-af4c-4aaf-941e-f7653032f3d0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:55.682771 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-23e99ced-af4c-4aaf-941e-f7653032f3d0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c" status: 200 len: 1270 microversion: 2.1 time: 0.118017 Oct 19 08:25:55.683898 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 178/356] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:55 2021] GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c => generated 1270 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:56.313515 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-98ff2e44-971f-4a1b-8a63-34881de22a15 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:56.314318 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-98ff2e44-971f-4a1b-8a63-34881de22a15 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:56.324748 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-98ff2e44-971f-4a1b-8a63-34881de22a15 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:56.325195 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-98ff2e44-971f-4a1b-8a63-34881de22a15 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:56.325972 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-98ff2e44-971f-4a1b-8a63-34881de22a15 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:56.326482 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-98ff2e44-971f-4a1b-8a63-34881de22a15 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:56.345787 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-5b8af0b9-43a3-4eb2-aa7e-60e665760b32 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:56.346763 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-5b8af0b9-43a3-4eb2-aa7e-60e665760b32 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:56.362028 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5b8af0b9-43a3-4eb2-aa7e-60e665760b32 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:56.362478 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5b8af0b9-43a3-4eb2-aa7e-60e665760b32 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:56.363294 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5b8af0b9-43a3-4eb2-aa7e-60e665760b32 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:56.363729 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5b8af0b9-43a3-4eb2-aa7e-60e665760b32 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:56.489651 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-5b8af0b9-43a3-4eb2-aa7e-60e665760b32 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 22976 microversion: 2.20 time: 0.147191 Oct 19 08:25:56.491834 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 179/357] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:25:56 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 22976 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:25:56.538459 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-557b3584-c1dc-4a22-a556-679785a1e612 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:56.539647 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-557b3584-c1dc-4a22-a556-679785a1e612 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:56.553112 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-557b3584-c1dc-4a22-a556-679785a1e612 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:56.553548 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-557b3584-c1dc-4a22-a556-679785a1e612 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:56.557322 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-557b3584-c1dc-4a22-a556-679785a1e612 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:56.557700 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-557b3584-c1dc-4a22-a556-679785a1e612 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:56.717325 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-98ff2e44-971f-4a1b-8a63-34881de22a15 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:56.724058 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-557b3584-c1dc-4a22-a556-679785a1e612 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 22940 microversion: 2.1 time: 0.190460 Oct 19 08:25:56.727986 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 180/358] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:25:56 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 22940 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:25:56.729209 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-98ff2e44-971f-4a1b-8a63-34881de22a15 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.419636 Oct 19 08:25:56.734705 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-55d3ab18-0fb5-4189-b9f3-5ac7744e1130 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:56.737167 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-55d3ab18-0fb5-4189-b9f3-5ac7744e1130 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 4bd61122-7096-461a-95b1-adc1dea18a0c] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:56.741960 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 179/359] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:56 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:56.752439 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-55d3ab18-0fb5-4189-b9f3-5ac7744e1130 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:56.752882 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-55d3ab18-0fb5-4189-b9f3-5ac7744e1130 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:56.753654 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-55d3ab18-0fb5-4189-b9f3-5ac7744e1130 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:56.759605 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-55d3ab18-0fb5-4189-b9f3-5ac7744e1130 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:57.074665 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-55d3ab18-0fb5-4189-b9f3-5ac7744e1130 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:57.084444 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-55d3ab18-0fb5-4189-b9f3-5ac7744e1130 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c" status: 200 len: 1318 microversion: 2.1 time: 0.354398 Oct 19 08:25:57.085601 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 181/360] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:56 2021] GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:57.179670 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-78963990-f74f-42fd-b6c7-cef9d1b199f2 tempest-VolumesNegativeTest-1493979550 tempest-VolumesNegativeTest-1493979550-project] Action: 'create', calling method: .version_select at 0x7fcadd429940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2009767272", "metadata": {"Type": "work"}}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:57.181435 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-78963990-f74f-42fd-b6c7-cef9d1b199f2 tempest-VolumesNegativeTest-1493979550 tempest-VolumesNegativeTest-1493979550-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=114105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:25:57.182453 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-78963990-f74f-42fd-b6c7-cef9d1b199f2 tempest-VolumesNegativeTest-1493979550 tempest-VolumesNegativeTest-1493979550-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.318957 Oct 19 08:25:57.183543 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 180/361] 10.222.0.26 () {60 vars in 1155 bytes} [Tue Oct 19 08:25:56 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 321 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 19 08:25:57.193204 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-d7e94421-9de7-4911-b0c3-21148fed4e3e tempest-VolumesNegativeTest-1493979550 tempest-VolumesNegativeTest-1493979550-project] Action: 'create', calling method: .version_select at 0x7fcaddbec430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1281444522", "metadata": {"Type": "work"}}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:57.194885 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-d7e94421-9de7-4911-b0c3-21148fed4e3e tempest-VolumesNegativeTest-1493979550 tempest-VolumesNegativeTest-1493979550-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=114106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:25:57.195695 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-d7e94421-9de7-4911-b0c3-21148fed4e3e tempest-VolumesNegativeTest-1493979550 tempest-VolumesNegativeTest-1493979550-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006359 Oct 19 08:25:57.196242 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 182/362] 10.222.0.26 () {60 vars in 1155 bytes} [Tue Oct 19 08:25:57 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 08:25:57.210573 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2d9421fc-08b9-49b4-aa40-360e15b802cc tempest-VolumesNegativeTest-1493979550 tempest-VolumesNegativeTest-1493979550-project] Action: 'create', calling method: .version_select at 0x7fcaddd99670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1750597691", "metadata": {"Type": "work"}}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:57.212322 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2d9421fc-08b9-49b4-aa40-360e15b802cc tempest-VolumesNegativeTest-1493979550 tempest-VolumesNegativeTest-1493979550-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=114105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:25:57.213434 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2d9421fc-08b9-49b4-aa40-360e15b802cc tempest-VolumesNegativeTest-1493979550 tempest-VolumesNegativeTest-1493979550-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011029 Oct 19 08:25:57.219776 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 181/363] 10.222.0.26 () {60 vars in 1155 bytes} [Tue Oct 19 08:25:57 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 08:25:57.223913 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e5875ad2-8b7a-4722-a174-3d91bc2be71f tempest-VolumesNegativeTest-1493979550 tempest-VolumesNegativeTest-1493979550-project] Calling method '.version_select at 0x7fcaddc4ce50>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:57.263052 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.wsgi [None req-e5875ad2-8b7a-4722-a174-3d91bc2be71f tempest-VolumesNegativeTest-1493979550 tempest-VolumesNegativeTest-1493979550-project] HTTP exception thrown: Volume tempest-invalid-1447265674 could not be found. Oct 19 08:25:57.265159 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e5875ad2-8b7a-4722-a174-3d91bc2be71f tempest-VolumesNegativeTest-1493979550 tempest-VolumesNegativeTest-1493979550-project] Returning 404 to user: Volume tempest-invalid-1447265674 could not be found. {{(pid=114106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:25:57.266322 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e5875ad2-8b7a-4722-a174-3d91bc2be71f tempest-VolumesNegativeTest-1493979550 tempest-VolumesNegativeTest-1493979550-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1447265674" status: 404 len: 99 microversion: 2.1 time: 0.046086 Oct 19 08:25:57.267010 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 183/364] 10.222.0.26 () {58 vars in 1217 bytes} [Tue Oct 19 08:25:57 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1447265674 => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 08:25:57.276425 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-34955350-fe8a-4fb0-a452-1c17596467b3 tempest-VolumesNegativeTest-1493979550 tempest-VolumesNegativeTest-1493979550-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004364 Oct 19 08:25:57.276914 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 182/365] 10.222.0.26 () {58 vars in 1139 bytes} [Tue Oct 19 08:25:57 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 19 08:25:57.289142 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-53f5c5ea-60d8-4892-b9cc-85fb4166cbaa tempest-VolumesNegativeTest-1493979550 tempest-VolumesNegativeTest-1493979550-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007048 Oct 19 08:25:57.294341 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 184/366] 10.222.0.26 () {58 vars in 1136 bytes} [Tue Oct 19 08:25:57 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 19 08:25:57.299532 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-95e83b9e-0ebe-402d-9671-b712e9898e96 tempest-VolumesNegativeTest-1493979550 tempest-VolumesNegativeTest-1493979550-project] Calling method '.version_select at 0x7fcadd4d9550>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:57.337518 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.wsgi [None req-95e83b9e-0ebe-402d-9671-b712e9898e96 tempest-VolumesNegativeTest-1493979550 tempest-VolumesNegativeTest-1493979550-project] HTTP exception thrown: Volume 756945c0-1bdb-4b95-9197-f53e3d223142 could not be found. Oct 19 08:25:57.339068 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-95e83b9e-0ebe-402d-9671-b712e9898e96 tempest-VolumesNegativeTest-1493979550 tempest-VolumesNegativeTest-1493979550-project] Returning 404 to user: Volume 756945c0-1bdb-4b95-9197-f53e3d223142 could not be found. {{(pid=114105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:25:57.340081 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-95e83b9e-0ebe-402d-9671-b712e9898e96 tempest-VolumesNegativeTest-1493979550 tempest-VolumesNegativeTest-1493979550-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/756945c0-1bdb-4b95-9197-f53e3d223142" status: 404 len: 109 microversion: 2.1 time: 0.044619 Oct 19 08:25:57.340783 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 183/367] 10.222.0.26 () {58 vars in 1247 bytes} [Tue Oct 19 08:25:57 2021] DELETE /compute/v2.1/os-volumes/756945c0-1bdb-4b95-9197-f53e3d223142 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 08:25:57.351091 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-71b4dec0-0fde-4633-80d0-f5e1330c6709 tempest-VolumesNegativeTest-1493979550 tempest-VolumesNegativeTest-1493979550-project] Calling method '.version_select at 0x7fcaddbe0b80>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:57.378741 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.wsgi [None req-71b4dec0-0fde-4633-80d0-f5e1330c6709 tempest-VolumesNegativeTest-1493979550 tempest-VolumesNegativeTest-1493979550-project] HTTP exception thrown: Volume d009783a-1de2-4857-a19c-cf217879e469 could not be found. Oct 19 08:25:57.379751 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-71b4dec0-0fde-4633-80d0-f5e1330c6709 tempest-VolumesNegativeTest-1493979550 tempest-VolumesNegativeTest-1493979550-project] Returning 404 to user: Volume d009783a-1de2-4857-a19c-cf217879e469 could not be found. {{(pid=114106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:25:57.380690 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-71b4dec0-0fde-4633-80d0-f5e1330c6709 tempest-VolumesNegativeTest-1493979550 tempest-VolumesNegativeTest-1493979550-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/d009783a-1de2-4857-a19c-cf217879e469" status: 404 len: 109 microversion: 2.1 time: 0.034067 Oct 19 08:25:57.381406 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 185/368] 10.222.0.26 () {58 vars in 1244 bytes} [Tue Oct 19 08:25:57 2021] GET /compute/v2.1/os-volumes/d009783a-1de2-4857-a19c-cf217879e469 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:25:57.402912 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-5745ed28-57db-41a7-aa4c-a81d226a2179 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-86984358", "imageRef": "9102a998-a580-4b4e-b6a1-3172273dd66d", "flavorRef": "452", "networks": [{"uuid": "3f69f0bf-630e-493a-a010-3869e8bbde66"}]}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:57.459942 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.network.neutron [None req-5745ed28-57db-41a7-aa4c-a81d226a2179 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] validate_networks() for [('3f69f0bf-630e-493a-a010-3869e8bbde66', None, None, None, None, None)] {{(pid=114105) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 19 08:25:57.502145 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-11c63ff0-9c42-49d5-b3bd-af386d71c968 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:57.503653 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-11c63ff0-9c42-49d5-b3bd-af386d71c968 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:57.511395 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-11c63ff0-9c42-49d5-b3bd-af386d71c968 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:57.512193 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-11c63ff0-9c42-49d5-b3bd-af386d71c968 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:57.513453 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-11c63ff0-9c42-49d5-b3bd-af386d71c968 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:57.513910 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-11c63ff0-9c42-49d5-b3bd-af386d71c968 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:57.632902 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-11c63ff0-9c42-49d5-b3bd-af386d71c968 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 23799 microversion: 2.20 time: 0.135332 Oct 19 08:25:57.637767 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 186/369] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:25:57 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 23799 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:25:57.741857 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a795dda1-dc73-4f9b-889a-d28ccdf3f1fd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:57.746362 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a795dda1-dc73-4f9b-889a-d28ccdf3f1fd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:57.763051 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a795dda1-dc73-4f9b-889a-d28ccdf3f1fd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:57.763505 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a795dda1-dc73-4f9b-889a-d28ccdf3f1fd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:57.764775 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a795dda1-dc73-4f9b-889a-d28ccdf3f1fd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:57.765228 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a795dda1-dc73-4f9b-889a-d28ccdf3f1fd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:57.867701 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a795dda1-dc73-4f9b-889a-d28ccdf3f1fd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 23795 microversion: 2.1 time: 0.134508 Oct 19 08:25:57.868570 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 187/370] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:25:57 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 23795 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:25:57.874149 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-6e018131-424e-40d2-9e28-f8a577ac82e3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:57.875703 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-6e018131-424e-40d2-9e28-f8a577ac82e3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:57.884517 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6e018131-424e-40d2-9e28-f8a577ac82e3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:57.885050 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6e018131-424e-40d2-9e28-f8a577ac82e3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:57.885993 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6e018131-424e-40d2-9e28-f8a577ac82e3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:57.887091 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6e018131-424e-40d2-9e28-f8a577ac82e3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:58.252132 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-5745ed28-57db-41a7-aa4c-a81d226a2179 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Flavor limits 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 08:25:58.252662 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-5745ed28-57db-41a7-aa4c-a81d226a2179 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Image limits 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 08:25:58.253138 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-5745ed28-57db-41a7-aa4c-a81d226a2179 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Flavor pref 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 08:25:58.253545 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-5745ed28-57db-41a7-aa4c-a81d226a2179 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Image pref 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 08:25:58.253958 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-5745ed28-57db-41a7-aa4c-a81d226a2179 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 08:25:58.262719 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5745ed28-57db-41a7-aa4c-a81d226a2179 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:58.263166 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5745ed28-57db-41a7-aa4c-a81d226a2179 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:58.264502 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5745ed28-57db-41a7-aa4c-a81d226a2179 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:58.265124 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5745ed28-57db-41a7-aa4c-a81d226a2179 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:58.282038 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-5745ed28-57db-41a7-aa4c-a81d226a2179 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Getting quotas for project f570556a465841b98162222c60bef779. Resources: {'cores', 'instances', 'ram'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:25:58.285992 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-5745ed28-57db-41a7-aa4c-a81d226a2179 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Getting quotas for user 92073952d8b34c159885daa7d0da3061 and project f570556a465841b98162222c60bef779. Resources: {'cores', 'instances', 'ram'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:25:58.296770 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-5745ed28-57db-41a7-aa4c-a81d226a2179 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Going to run 1 instances... {{(pid=114105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 19 08:25:58.299221 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-5745ed28-57db-41a7-aa4c-a81d226a2179 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: 61889472-0e20-46bc-94d3-c4c42883a5b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9102a998-a580-4b4e-b6a1-3172273dd66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 19 08:25:58.311489 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-6e018131-424e-40d2-9e28-f8a577ac82e3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:58.319075 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-6e018131-424e-40d2-9e28-f8a577ac82e3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.449160 Oct 19 08:25:58.319751 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 188/371] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:57 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:58.324401 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-bd7db206-f863-4aca-8b9d-f122a08dea28 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:58.328457 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-bd7db206-f863-4aca-8b9d-f122a08dea28 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 4bd61122-7096-461a-95b1-adc1dea18a0c] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:58.343282 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bd7db206-f863-4aca-8b9d-f122a08dea28 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:58.344834 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bd7db206-f863-4aca-8b9d-f122a08dea28 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:58.345727 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bd7db206-f863-4aca-8b9d-f122a08dea28 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:58.346171 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bd7db206-f863-4aca-8b9d-f122a08dea28 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:58.399579 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-5745ed28-57db-41a7-aa4c-a81d226a2179 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.003755 Oct 19 08:25:58.405193 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 184/372] 10.222.0.26 () {60 vars in 1146 bytes} [Tue Oct 19 08:25:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 1005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 08:25:58.410865 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-0b66c06a-24d2-41ab-815f-5028d17a0ed4 req-c4b402ad-3a7f-4ce8-b4a5-5e1a1cc432e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bd61122-7096-461a-95b1-adc1dea18a0c", "tag": "6a155696-ac5e-466f-9258-1a6e5fa773b5"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:58.413120 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:25:58.413120 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:25:58.422330 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-0b66c06a-24d2-41ab-815f-5028d17a0ed4 req-c4b402ad-3a7f-4ce8-b4a5-5e1a1cc432e6 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:58.422821 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-0b66c06a-24d2-41ab-815f-5028d17a0ed4 req-c4b402ad-3a7f-4ce8-b4a5-5e1a1cc432e6 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:58.435560 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-0b66c06a-24d2-41ab-815f-5028d17a0ed4 req-c4b402ad-3a7f-4ce8-b4a5-5e1a1cc432e6 service nova] Creating event network-changed:6a155696-ac5e-466f-9258-1a6e5fa773b5 for instance 4bd61122-7096-461a-95b1-adc1dea18a0c on hv-cinder-81398 Oct 19 08:25:58.441630 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-0b66c06a-24d2-41ab-815f-5028d17a0ed4 req-c4b402ad-3a7f-4ce8-b4a5-5e1a1cc432e6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039782 Oct 19 08:25:58.442482 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 185/373] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:25:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:25:58.448249 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-3c82a2f5-3e68-46bd-8abe-bc8d9699f695 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:58.448948 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-3c82a2f5-3e68-46bd-8abe-bc8d9699f695 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: 61889472-0e20-46bc-94d3-c4c42883a5b4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:58.771119 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-3c82a2f5-3e68-46bd-8abe-bc8d9699f695 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:58.780376 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-3c82a2f5-3e68-46bd-8abe-bc8d9699f695 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4" status: 200 len: 1217 microversion: 2.1 time: 0.335585 Oct 19 08:25:58.780841 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 186/374] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:58 2021] GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4 => generated 1217 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:58.792797 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-fc29e9f3-6400-405f-852f-c1b53da9f15d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:58.792797 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-fc29e9f3-6400-405f-852f-c1b53da9f15d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:58.796755 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fc29e9f3-6400-405f-852f-c1b53da9f15d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:58.797010 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fc29e9f3-6400-405f-852f-c1b53da9f15d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:58.799079 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fc29e9f3-6400-405f-852f-c1b53da9f15d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:58.799340 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fc29e9f3-6400-405f-852f-c1b53da9f15d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:58.937604 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-bd7db206-f863-4aca-8b9d-f122a08dea28 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:58.941115 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-fc29e9f3-6400-405f-852f-c1b53da9f15d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 24787 microversion: 2.20 time: 0.158736 Oct 19 08:25:58.942468 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 187/375] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:25:58 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 24787 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:25:58.950536 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-bd7db206-f863-4aca-8b9d-f122a08dea28 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c" status: 200 len: 1318 microversion: 2.1 time: 0.629478 Oct 19 08:25:58.951318 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 189/376] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:58 2021] GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c => generated 1318 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:58.963084 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-cfe1cd26-beec-41da-8abb-3f2d2beb2dd7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:58.964356 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-cfe1cd26-beec-41da-8abb-3f2d2beb2dd7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:58.975263 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cfe1cd26-beec-41da-8abb-3f2d2beb2dd7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:58.976127 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cfe1cd26-beec-41da-8abb-3f2d2beb2dd7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:58.977253 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cfe1cd26-beec-41da-8abb-3f2d2beb2dd7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:58.977909 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cfe1cd26-beec-41da-8abb-3f2d2beb2dd7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:59.080760 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-cfe1cd26-beec-41da-8abb-3f2d2beb2dd7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 24514 microversion: 2.1 time: 0.136016 Oct 19 08:25:59.084600 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 188/377] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:25:58 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 24514 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:25:59.337000 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-fbcf1b25-5afd-49e2-bbfd-5ac0b0c7b1a0 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:59.337907 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-fbcf1b25-5afd-49e2-bbfd-5ac0b0c7b1a0 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:59.345093 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fbcf1b25-5afd-49e2-bbfd-5ac0b0c7b1a0 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:59.345873 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fbcf1b25-5afd-49e2-bbfd-5ac0b0c7b1a0 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:59.346946 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fbcf1b25-5afd-49e2-bbfd-5ac0b0c7b1a0 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:59.347368 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fbcf1b25-5afd-49e2-bbfd-5ac0b0c7b1a0 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:59.586442 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-fbcf1b25-5afd-49e2-bbfd-5ac0b0c7b1a0 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:25:59.595374 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-fbcf1b25-5afd-49e2-bbfd-5ac0b0c7b1a0 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.262229 Oct 19 08:25:59.596165 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 190/378] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:59 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:25:59.806341 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2668b72a-2f2a-4317-8905-110c2a22e0b2 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:25:59.807792 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2668b72a-2f2a-4317-8905-110c2a22e0b2 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: 61889472-0e20-46bc-94d3-c4c42883a5b4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:59.846913 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2668b72a-2f2a-4317-8905-110c2a22e0b2 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:59.850769 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2668b72a-2f2a-4317-8905-110c2a22e0b2 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:59.853905 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2668b72a-2f2a-4317-8905-110c2a22e0b2 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:59.855796 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2668b72a-2f2a-4317-8905-110c2a22e0b2 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:59.954338 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-9b3626cc-ac8e-4433-a5e0-47a41b961746 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:25:59.956332 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-9b3626cc-ac8e-4433-a5e0-47a41b961746 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:25:59.963282 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9b3626cc-ac8e-4433-a5e0-47a41b961746 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:59.964049 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9b3626cc-ac8e-4433-a5e0-47a41b961746 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:25:59.965028 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9b3626cc-ac8e-4433-a5e0-47a41b961746 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:25:59.965675 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9b3626cc-ac8e-4433-a5e0-47a41b961746 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:00.005338 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-2668b72a-2f2a-4317-8905-110c2a22e0b2 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:00.013314 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2668b72a-2f2a-4317-8905-110c2a22e0b2 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4" status: 200 len: 1275 microversion: 2.1 time: 0.212370 Oct 19 08:26:00.014327 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 189/379] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:25:59 2021] GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4 => generated 1275 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:00.019691 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-09dceb24-01be-4f43-ae77-b397a35494b0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:00.020546 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-09dceb24-01be-4f43-ae77-b397a35494b0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 4bd61122-7096-461a-95b1-adc1dea18a0c] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:00.027557 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-09dceb24-01be-4f43-ae77-b397a35494b0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:00.028034 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-09dceb24-01be-4f43-ae77-b397a35494b0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:00.028838 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-09dceb24-01be-4f43-ae77-b397a35494b0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:00.029997 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-09dceb24-01be-4f43-ae77-b397a35494b0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:00.172155 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-9b3626cc-ac8e-4433-a5e0-47a41b961746 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 25718 microversion: 2.20 time: 0.221894 Oct 19 08:26:00.173865 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 191/380] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:25:59 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 25718 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:26:00.179994 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b5b41d86-f1fd-4f77-97b7-60a32c909e59 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:00.182266 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b5b41d86-f1fd-4f77-97b7-60a32c909e59 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:00.192402 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b5b41d86-f1fd-4f77-97b7-60a32c909e59 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:00.193146 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b5b41d86-f1fd-4f77-97b7-60a32c909e59 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:00.194859 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b5b41d86-f1fd-4f77-97b7-60a32c909e59 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:00.195496 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b5b41d86-f1fd-4f77-97b7-60a32c909e59 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:00.236046 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-09dceb24-01be-4f43-ae77-b397a35494b0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:00.245203 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-09dceb24-01be-4f43-ae77-b397a35494b0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c" status: 200 len: 1318 microversion: 2.1 time: 0.229240 Oct 19 08:26:00.245877 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 190/381] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:00 2021] GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:00.364203 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b5b41d86-f1fd-4f77-97b7-60a32c909e59 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 25614 microversion: 2.1 time: 0.188448 Oct 19 08:26:00.368100 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 192/382] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:00 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 25614 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:26:00.612962 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8532dbbe-c7f4-4182-8814-6a626b9a0189 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:00.613782 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-8532dbbe-c7f4-4182-8814-6a626b9a0189 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:00.619847 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8532dbbe-c7f4-4182-8814-6a626b9a0189 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:00.620284 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8532dbbe-c7f4-4182-8814-6a626b9a0189 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:00.621040 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8532dbbe-c7f4-4182-8814-6a626b9a0189 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:00.621460 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8532dbbe-c7f4-4182-8814-6a626b9a0189 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:00.807361 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-8532dbbe-c7f4-4182-8814-6a626b9a0189 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:00.815680 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-8532dbbe-c7f4-4182-8814-6a626b9a0189 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.206289 Oct 19 08:26:00.816358 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 191/383] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:00 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:01.031804 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-d55e92e9-139f-44cd-b5bb-18b2ed6ac719 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:01.032514 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-d55e92e9-139f-44cd-b5bb-18b2ed6ac719 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: 61889472-0e20-46bc-94d3-c4c42883a5b4] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:01.039904 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d55e92e9-139f-44cd-b5bb-18b2ed6ac719 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:01.040396 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d55e92e9-139f-44cd-b5bb-18b2ed6ac719 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:01.041140 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d55e92e9-139f-44cd-b5bb-18b2ed6ac719 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:01.041639 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d55e92e9-139f-44cd-b5bb-18b2ed6ac719 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:01.185591 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-16903859-f808-4fb8-b85c-3c09a3406d18 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:01.186939 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-16903859-f808-4fb8-b85c-3c09a3406d18 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:01.194121 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-16903859-f808-4fb8-b85c-3c09a3406d18 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:01.194837 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-16903859-f808-4fb8-b85c-3c09a3406d18 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:01.195925 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-16903859-f808-4fb8-b85c-3c09a3406d18 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:01.196567 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-16903859-f808-4fb8-b85c-3c09a3406d18 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:01.280865 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-d55e92e9-139f-44cd-b5bb-18b2ed6ac719 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:01.290631 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-d55e92e9-139f-44cd-b5bb-18b2ed6ac719 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4" status: 200 len: 1317 microversion: 2.1 time: 0.262525 Oct 19 08:26:01.291586 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 193/384] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:01 2021] GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4 => generated 1317 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:01.300523 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b6b01228-b07c-4450-8dc4-37bcabb87993 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:01.301569 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b6b01228-b07c-4450-8dc4-37bcabb87993 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 4bd61122-7096-461a-95b1-adc1dea18a0c] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:01.308997 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b6b01228-b07c-4450-8dc4-37bcabb87993 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:01.309638 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b6b01228-b07c-4450-8dc4-37bcabb87993 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:01.310504 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b6b01228-b07c-4450-8dc4-37bcabb87993 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:01.311764 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b6b01228-b07c-4450-8dc4-37bcabb87993 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:01.339374 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-16903859-f808-4fb8-b85c-3c09a3406d18 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 26478 microversion: 2.20 time: 0.158994 Oct 19 08:26:01.344620 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 192/385] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:01 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 26478 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:01.376579 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-f9000944-1a26-4b31-b565-dc273c6dca6c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:01.377855 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-f9000944-1a26-4b31-b565-dc273c6dca6c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:01.389920 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f9000944-1a26-4b31-b565-dc273c6dca6c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:01.390706 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f9000944-1a26-4b31-b565-dc273c6dca6c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:01.392001 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f9000944-1a26-4b31-b565-dc273c6dca6c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:01.393233 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f9000944-1a26-4b31-b565-dc273c6dca6c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:01.513939 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-f9000944-1a26-4b31-b565-dc273c6dca6c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 26316 microversion: 2.1 time: 0.141530 Oct 19 08:26:01.517085 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 193/386] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:01 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 26316 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:26:01.525805 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-0d2e5f9d-d72b-4c70-846c-38d428a05c4d req-fdaaa9e1-c9f2-49e8-b634-67187fb3c314 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61889472-0e20-46bc-94d3-c4c42883a5b4", "tag": "a4cb6d5a-dee1-4c5d-802a-33281ff7b5a1"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:01.528046 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:26:01.528046 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:26:01.531423 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-b6b01228-b07c-4450-8dc4-37bcabb87993 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:01.539691 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-0d2e5f9d-d72b-4c70-846c-38d428a05c4d req-fdaaa9e1-c9f2-49e8-b634-67187fb3c314 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:01.541181 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-0d2e5f9d-d72b-4c70-846c-38d428a05c4d req-fdaaa9e1-c9f2-49e8-b634-67187fb3c314 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:01.544552 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b6b01228-b07c-4450-8dc4-37bcabb87993 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c" status: 200 len: 1318 microversion: 2.1 time: 0.250556 Oct 19 08:26:01.545187 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 194/387] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:01 2021] GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:01.572202 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-0d2e5f9d-d72b-4c70-846c-38d428a05c4d req-fdaaa9e1-c9f2-49e8-b634-67187fb3c314 service nova] Creating event network-changed:a4cb6d5a-dee1-4c5d-802a-33281ff7b5a1 for instance 61889472-0e20-46bc-94d3-c4c42883a5b4 on hv-cinder-81398 Oct 19 08:26:01.578142 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-0d2e5f9d-d72b-4c70-846c-38d428a05c4d req-fdaaa9e1-c9f2-49e8-b634-67187fb3c314 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057755 Oct 19 08:26:01.578944 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 194/388] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:26:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:26:01.832834 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3354b41f-ab9f-4ddf-a1ef-ea107e253234 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:01.833572 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3354b41f-ab9f-4ddf-a1ef-ea107e253234 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:01.841072 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3354b41f-ab9f-4ddf-a1ef-ea107e253234 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:01.841623 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3354b41f-ab9f-4ddf-a1ef-ea107e253234 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:01.843312 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3354b41f-ab9f-4ddf-a1ef-ea107e253234 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:01.843917 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3354b41f-ab9f-4ddf-a1ef-ea107e253234 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:02.045626 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3354b41f-ab9f-4ddf-a1ef-ea107e253234 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:02.053065 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3354b41f-ab9f-4ddf-a1ef-ea107e253234 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.223850 Oct 19 08:26:02.053625 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 195/389] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:01 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:02.307577 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-238a039e-3eed-4471-a175-2bfa998f2641 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:02.308905 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-238a039e-3eed-4471-a175-2bfa998f2641 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: 61889472-0e20-46bc-94d3-c4c42883a5b4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:02.316227 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-238a039e-3eed-4471-a175-2bfa998f2641 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:02.316672 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-238a039e-3eed-4471-a175-2bfa998f2641 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:02.317460 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-238a039e-3eed-4471-a175-2bfa998f2641 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:02.317880 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-238a039e-3eed-4471-a175-2bfa998f2641 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:02.354033 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3403afaa-6641-409c-a087-6ff092c038a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:02.355048 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3403afaa-6641-409c-a087-6ff092c038a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:02.361806 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3403afaa-6641-409c-a087-6ff092c038a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:02.362138 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3403afaa-6641-409c-a087-6ff092c038a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:02.364064 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3403afaa-6641-409c-a087-6ff092c038a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:02.364064 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3403afaa-6641-409c-a087-6ff092c038a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:02.480772 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3403afaa-6641-409c-a087-6ff092c038a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 26980 microversion: 2.20 time: 0.132543 Oct 19 08:26:02.481399 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 196/390] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:02 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 26980 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:26:02.483658 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-238a039e-3eed-4471-a175-2bfa998f2641 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:02.491317 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-238a039e-3eed-4471-a175-2bfa998f2641 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4" status: 200 len: 1317 microversion: 2.1 time: 0.187879 Oct 19 08:26:02.491874 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 195/391] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:02 2021] GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4 => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:02.532846 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-77e8be62-0f90-4a48-b12e-cc0d7dc7ab9f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:02.534132 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-77e8be62-0f90-4a48-b12e-cc0d7dc7ab9f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:02.541225 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-77e8be62-0f90-4a48-b12e-cc0d7dc7ab9f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:02.541964 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-77e8be62-0f90-4a48-b12e-cc0d7dc7ab9f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:02.543019 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-77e8be62-0f90-4a48-b12e-cc0d7dc7ab9f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:02.543651 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-77e8be62-0f90-4a48-b12e-cc0d7dc7ab9f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:02.562119 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-1a5df571-b239-4b06-a6db-61048564939c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:02.562750 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-1a5df571-b239-4b06-a6db-61048564939c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 4bd61122-7096-461a-95b1-adc1dea18a0c] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:02.569369 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1a5df571-b239-4b06-a6db-61048564939c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:02.569974 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1a5df571-b239-4b06-a6db-61048564939c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:02.570608 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1a5df571-b239-4b06-a6db-61048564939c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:02.571209 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1a5df571-b239-4b06-a6db-61048564939c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:02.649273 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-77e8be62-0f90-4a48-b12e-cc0d7dc7ab9f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 26982 microversion: 2.1 time: 0.121122 Oct 19 08:26:02.650671 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 197/392] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:02 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 26982 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:26:02.766607 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-1a5df571-b239-4b06-a6db-61048564939c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:02.773848 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-1a5df571-b239-4b06-a6db-61048564939c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c" status: 200 len: 1318 microversion: 2.1 time: 0.215812 Oct 19 08:26:02.774336 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 196/393] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:02 2021] GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:03.071455 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e335cf75-56a3-412e-86e7-2c3b087d16e3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:03.072142 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e335cf75-56a3-412e-86e7-2c3b087d16e3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:03.079529 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e335cf75-56a3-412e-86e7-2c3b087d16e3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:03.079978 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e335cf75-56a3-412e-86e7-2c3b087d16e3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:03.080723 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e335cf75-56a3-412e-86e7-2c3b087d16e3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:03.081139 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e335cf75-56a3-412e-86e7-2c3b087d16e3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:03.205072 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-e335cf75-56a3-412e-86e7-2c3b087d16e3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:03.212460 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e335cf75-56a3-412e-86e7-2c3b087d16e3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.145057 Oct 19 08:26:03.213016 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 198/394] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:03 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:03.492826 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-64cd4156-751e-498a-8214-b75d112e1406 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:03.493775 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-64cd4156-751e-498a-8214-b75d112e1406 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:03.499644 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-64cd4156-751e-498a-8214-b75d112e1406 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:03.500083 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-64cd4156-751e-498a-8214-b75d112e1406 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:03.500831 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-64cd4156-751e-498a-8214-b75d112e1406 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:03.501254 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-64cd4156-751e-498a-8214-b75d112e1406 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:03.508721 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-2fe744df-3784-49ed-923b-0914948ca470 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:03.509322 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-2fe744df-3784-49ed-923b-0914948ca470 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: 61889472-0e20-46bc-94d3-c4c42883a5b4] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:03.515971 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2fe744df-3784-49ed-923b-0914948ca470 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:03.516418 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2fe744df-3784-49ed-923b-0914948ca470 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:03.517182 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2fe744df-3784-49ed-923b-0914948ca470 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:03.517610 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2fe744df-3784-49ed-923b-0914948ca470 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:03.640008 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-2fe744df-3784-49ed-923b-0914948ca470 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:03.647435 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-2fe744df-3784-49ed-923b-0914948ca470 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4" status: 200 len: 1317 microversion: 2.1 time: 0.142386 Oct 19 08:26:03.648172 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 199/395] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:03 2021] GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4 => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:26:03.660772 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-64cd4156-751e-498a-8214-b75d112e1406 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 27616 microversion: 2.20 time: 0.171364 Oct 19 08:26:03.662127 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 197/396] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:03 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 27616 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:03.662917 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-4a67d231-e304-4823-9936-483b51eb680b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:03.664497 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-4a67d231-e304-4823-9936-483b51eb680b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:03.671566 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4a67d231-e304-4823-9936-483b51eb680b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:03.672374 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4a67d231-e304-4823-9936-483b51eb680b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:03.673252 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4a67d231-e304-4823-9936-483b51eb680b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:03.674050 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4a67d231-e304-4823-9936-483b51eb680b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:03.776645 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-4a67d231-e304-4823-9936-483b51eb680b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 27451 microversion: 2.1 time: 0.117485 Oct 19 08:26:03.777639 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 200/397] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:03 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 27451 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:26:03.793112 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-48f061b3-5d28-451b-9aff-f329ab994511 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:03.794100 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-48f061b3-5d28-451b-9aff-f329ab994511 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 4bd61122-7096-461a-95b1-adc1dea18a0c] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:03.803062 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-48f061b3-5d28-451b-9aff-f329ab994511 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:03.803517 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-48f061b3-5d28-451b-9aff-f329ab994511 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:03.804579 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-48f061b3-5d28-451b-9aff-f329ab994511 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:03.805129 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-48f061b3-5d28-451b-9aff-f329ab994511 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:03.943035 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-48f061b3-5d28-451b-9aff-f329ab994511 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:03.950561 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-48f061b3-5d28-451b-9aff-f329ab994511 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c" status: 200 len: 1318 microversion: 2.1 time: 0.162346 Oct 19 08:26:03.951114 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 198/398] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:03 2021] GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:04.229787 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-f279265e-9a03-4b95-be83-7336ef30cbe3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:04.230645 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-f279265e-9a03-4b95-be83-7336ef30cbe3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:04.237499 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f279265e-9a03-4b95-be83-7336ef30cbe3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:04.237928 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f279265e-9a03-4b95-be83-7336ef30cbe3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:04.238715 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f279265e-9a03-4b95-be83-7336ef30cbe3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:04.239135 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f279265e-9a03-4b95-be83-7336ef30cbe3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:04.357430 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-f279265e-9a03-4b95-be83-7336ef30cbe3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:04.365612 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-f279265e-9a03-4b95-be83-7336ef30cbe3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.140163 Oct 19 08:26:04.366155 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 201/399] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:04 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:04.664448 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-fdb9e909-2605-4356-91fe-80b061a77801 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:04.665050 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-fdb9e909-2605-4356-91fe-80b061a77801 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: 61889472-0e20-46bc-94d3-c4c42883a5b4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:04.673229 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e19a9d77-0d93-44ee-a222-9788e448f216 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:04.674200 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e19a9d77-0d93-44ee-a222-9788e448f216 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:04.677230 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fdb9e909-2605-4356-91fe-80b061a77801 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:04.677666 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fdb9e909-2605-4356-91fe-80b061a77801 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:04.678527 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fdb9e909-2605-4356-91fe-80b061a77801 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:04.678955 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fdb9e909-2605-4356-91fe-80b061a77801 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:04.679884 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e19a9d77-0d93-44ee-a222-9788e448f216 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:04.680327 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e19a9d77-0d93-44ee-a222-9788e448f216 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:04.681091 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e19a9d77-0d93-44ee-a222-9788e448f216 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:04.681513 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e19a9d77-0d93-44ee-a222-9788e448f216 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:04.784928 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e19a9d77-0d93-44ee-a222-9788e448f216 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 27789 microversion: 2.20 time: 0.115663 Oct 19 08:26:04.785708 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 202/400] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:04 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 27789 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:26:04.790470 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-2c3c90cb-4915-4712-a148-6cf37b1f4699 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:04.791466 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-2c3c90cb-4915-4712-a148-6cf37b1f4699 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:04.799994 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-fdb9e909-2605-4356-91fe-80b061a77801 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:04.800794 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2c3c90cb-4915-4712-a148-6cf37b1f4699 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:04.801239 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2c3c90cb-4915-4712-a148-6cf37b1f4699 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:04.802039 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2c3c90cb-4915-4712-a148-6cf37b1f4699 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:04.802468 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2c3c90cb-4915-4712-a148-6cf37b1f4699 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:04.807617 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-fdb9e909-2605-4356-91fe-80b061a77801 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4" status: 200 len: 1317 microversion: 2.1 time: 0.146960 Oct 19 08:26:04.808170 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 199/401] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:04 2021] GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4 => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:04.968343 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-80979b0e-de2f-4543-8c4e-782da0bdc467 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:04.969465 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-80979b0e-de2f-4543-8c4e-782da0bdc467 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 4bd61122-7096-461a-95b1-adc1dea18a0c] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:04.975617 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-80979b0e-de2f-4543-8c4e-782da0bdc467 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:04.976048 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-80979b0e-de2f-4543-8c4e-782da0bdc467 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:04.976804 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-80979b0e-de2f-4543-8c4e-782da0bdc467 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:04.977392 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-80979b0e-de2f-4543-8c4e-782da0bdc467 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:05.093390 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-2c3c90cb-4915-4712-a148-6cf37b1f4699 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 27774 microversion: 2.1 time: 0.306109 Oct 19 08:26:05.097349 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 203/402] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:04 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 27774 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:26:05.116641 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-80979b0e-de2f-4543-8c4e-782da0bdc467 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:05.124590 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-80979b0e-de2f-4543-8c4e-782da0bdc467 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c" status: 200 len: 1318 microversion: 2.1 time: 0.160814 Oct 19 08:26:05.125277 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 200/403] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:04 2021] GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:05.385385 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-568e84e5-28bc-4ffc-8c71-c04338896e02 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:05.386180 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-568e84e5-28bc-4ffc-8c71-c04338896e02 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:05.393467 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-568e84e5-28bc-4ffc-8c71-c04338896e02 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:05.393988 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-568e84e5-28bc-4ffc-8c71-c04338896e02 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:05.394862 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-568e84e5-28bc-4ffc-8c71-c04338896e02 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:05.395358 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-568e84e5-28bc-4ffc-8c71-c04338896e02 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:05.515604 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-568e84e5-28bc-4ffc-8c71-c04338896e02 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:05.522645 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-568e84e5-28bc-4ffc-8c71-c04338896e02 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.141689 Oct 19 08:26:05.523192 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 204/404] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:05 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:05.797193 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-724358c0-350f-4655-adb3-1f96ee235ce8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:05.798158 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-724358c0-350f-4655-adb3-1f96ee235ce8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:05.804239 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-724358c0-350f-4655-adb3-1f96ee235ce8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:05.804681 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-724358c0-350f-4655-adb3-1f96ee235ce8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:05.805447 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-724358c0-350f-4655-adb3-1f96ee235ce8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:05.805873 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-724358c0-350f-4655-adb3-1f96ee235ce8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:05.824831 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-9e6f4f49-db60-4f42-8a64-7b846e4329bb tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:05.825725 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-9e6f4f49-db60-4f42-8a64-7b846e4329bb tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: 61889472-0e20-46bc-94d3-c4c42883a5b4] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:05.832920 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9e6f4f49-db60-4f42-8a64-7b846e4329bb tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:05.833370 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9e6f4f49-db60-4f42-8a64-7b846e4329bb tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:05.834159 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9e6f4f49-db60-4f42-8a64-7b846e4329bb tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:05.835008 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9e6f4f49-db60-4f42-8a64-7b846e4329bb tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:05.892658 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-724358c0-350f-4655-adb3-1f96ee235ce8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28095 microversion: 2.20 time: 0.099786 Oct 19 08:26:05.893831 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 201/405] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:05 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28095 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:05.957592 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-9e6f4f49-db60-4f42-8a64-7b846e4329bb tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:05.964635 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-9e6f4f49-db60-4f42-8a64-7b846e4329bb tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4" status: 200 len: 1317 microversion: 2.1 time: 0.143881 Oct 19 08:26:05.965181 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 205/406] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:05 2021] GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4 => generated 1317 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:06.105284 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-7af0bcaa-efbf-4edf-a00b-1368b97f02e5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:06.106339 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-7af0bcaa-efbf-4edf-a00b-1368b97f02e5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:06.113340 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7af0bcaa-efbf-4edf-a00b-1368b97f02e5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:06.113791 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7af0bcaa-efbf-4edf-a00b-1368b97f02e5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:06.114588 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7af0bcaa-efbf-4edf-a00b-1368b97f02e5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:06.115032 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7af0bcaa-efbf-4edf-a00b-1368b97f02e5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:06.141842 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-0f4fab9f-8ee1-45a2-ba74-a6b0184ca961 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:06.142614 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-0f4fab9f-8ee1-45a2-ba74-a6b0184ca961 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 4bd61122-7096-461a-95b1-adc1dea18a0c] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:06.148436 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0f4fab9f-8ee1-45a2-ba74-a6b0184ca961 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:06.148877 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0f4fab9f-8ee1-45a2-ba74-a6b0184ca961 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:06.149638 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0f4fab9f-8ee1-45a2-ba74-a6b0184ca961 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:06.150062 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0f4fab9f-8ee1-45a2-ba74-a6b0184ca961 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:06.199515 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-7af0bcaa-efbf-4edf-a00b-1368b97f02e5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 27917 microversion: 2.1 time: 0.097945 Oct 19 08:26:06.200166 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 202/407] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:06 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 27917 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:26:06.281733 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-0f4fab9f-8ee1-45a2-ba74-a6b0184ca961 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:06.289099 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-0f4fab9f-8ee1-45a2-ba74-a6b0184ca961 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c" status: 200 len: 1318 microversion: 2.1 time: 0.151969 Oct 19 08:26:06.289653 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 206/408] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:06 2021] GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:26:06.540342 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-9f48523b-b638-4ee6-85de-c196d05fd9a3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:06.541133 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-9f48523b-b638-4ee6-85de-c196d05fd9a3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:06.550775 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9f48523b-b638-4ee6-85de-c196d05fd9a3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:06.551762 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9f48523b-b638-4ee6-85de-c196d05fd9a3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:06.552963 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9f48523b-b638-4ee6-85de-c196d05fd9a3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:06.553434 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9f48523b-b638-4ee6-85de-c196d05fd9a3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:06.684311 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-9f48523b-b638-4ee6-85de-c196d05fd9a3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:06.698547 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-9f48523b-b638-4ee6-85de-c196d05fd9a3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.162360 Oct 19 08:26:06.700254 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 203/409] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:06 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:06.905265 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e46c23df-f90f-4564-8794-c5f2b9cb6faf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:06.906806 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e46c23df-f90f-4564-8794-c5f2b9cb6faf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:06.913364 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e46c23df-f90f-4564-8794-c5f2b9cb6faf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:06.913808 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e46c23df-f90f-4564-8794-c5f2b9cb6faf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:06.914633 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e46c23df-f90f-4564-8794-c5f2b9cb6faf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:06.915007 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e46c23df-f90f-4564-8794-c5f2b9cb6faf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:06.981072 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-9220e446-7b55-4d52-b84b-185deaeb4c33 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:06.981669 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-9220e446-7b55-4d52-b84b-185deaeb4c33 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: 61889472-0e20-46bc-94d3-c4c42883a5b4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:06.988317 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9220e446-7b55-4d52-b84b-185deaeb4c33 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:06.988766 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9220e446-7b55-4d52-b84b-185deaeb4c33 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:06.989520 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9220e446-7b55-4d52-b84b-185deaeb4c33 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:06.989946 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9220e446-7b55-4d52-b84b-185deaeb4c33 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:07.065872 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e46c23df-f90f-4564-8794-c5f2b9cb6faf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28212 microversion: 2.20 time: 0.164639 Oct 19 08:26:07.066539 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 207/410] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:06 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28212 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:07.107770 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-9220e446-7b55-4d52-b84b-185deaeb4c33 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:07.114986 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-9220e446-7b55-4d52-b84b-185deaeb4c33 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4" status: 200 len: 1317 microversion: 2.1 time: 0.137451 Oct 19 08:26:07.115579 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 204/411] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:06 2021] GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4 => generated 1317 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:07.212162 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-465ea8c1-3c0e-4bfa-9a8d-a90be526d1b0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:07.213110 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-465ea8c1-3c0e-4bfa-9a8d-a90be526d1b0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:07.219545 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-465ea8c1-3c0e-4bfa-9a8d-a90be526d1b0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:07.219984 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-465ea8c1-3c0e-4bfa-9a8d-a90be526d1b0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:07.220737 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-465ea8c1-3c0e-4bfa-9a8d-a90be526d1b0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:07.221164 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-465ea8c1-3c0e-4bfa-9a8d-a90be526d1b0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:07.304801 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-1724e59b-b563-46e2-afff-003464399261 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:07.305407 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-1724e59b-b563-46e2-afff-003464399261 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 4bd61122-7096-461a-95b1-adc1dea18a0c] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:07.312078 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1724e59b-b563-46e2-afff-003464399261 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:07.312522 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1724e59b-b563-46e2-afff-003464399261 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:07.313289 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1724e59b-b563-46e2-afff-003464399261 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:07.313722 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1724e59b-b563-46e2-afff-003464399261 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:07.433482 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-1724e59b-b563-46e2-afff-003464399261 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:07.441234 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-1724e59b-b563-46e2-afff-003464399261 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c" status: 200 len: 1318 microversion: 2.1 time: 0.140084 Oct 19 08:26:07.441795 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 205/412] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:07 2021] GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:26:07.715981 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-dd62c7f6-74dc-47c7-95d9-72be7dc4e637 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:07.716579 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-dd62c7f6-74dc-47c7-95d9-72be7dc4e637 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:07.722772 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dd62c7f6-74dc-47c7-95d9-72be7dc4e637 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:07.723220 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dd62c7f6-74dc-47c7-95d9-72be7dc4e637 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:07.723984 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dd62c7f6-74dc-47c7-95d9-72be7dc4e637 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:07.724417 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dd62c7f6-74dc-47c7-95d9-72be7dc4e637 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:08.042587 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-dd62c7f6-74dc-47c7-95d9-72be7dc4e637 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:08.050256 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-dd62c7f6-74dc-47c7-95d9-72be7dc4e637 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.337807 Oct 19 08:26:08.050842 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 206/413] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:07 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:26:08.077377 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-3612f18a-c39b-438c-b81c-d2c9208e650c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:08.078440 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-3612f18a-c39b-438c-b81c-d2c9208e650c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:08.084210 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3612f18a-c39b-438c-b81c-d2c9208e650c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:08.084648 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3612f18a-c39b-438c-b81c-d2c9208e650c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:08.085424 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3612f18a-c39b-438c-b81c-d2c9208e650c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:08.085842 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3612f18a-c39b-438c-b81c-d2c9208e650c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:08.777485 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-465ea8c1-3c0e-4bfa-9a8d-a90be526d1b0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28035 microversion: 2.1 time: 1.569090 Oct 19 08:26:08.778999 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 208/414] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:07 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28035 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:26:08.783438 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b5a6c9c2-5e81-4984-9bd9-1ad940439668 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:08.784262 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b5a6c9c2-5e81-4984-9bd9-1ad940439668 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: 61889472-0e20-46bc-94d3-c4c42883a5b4] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:08.790517 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b5a6c9c2-5e81-4984-9bd9-1ad940439668 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:08.790982 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b5a6c9c2-5e81-4984-9bd9-1ad940439668 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:08.791737 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b5a6c9c2-5e81-4984-9bd9-1ad940439668 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:08.792166 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b5a6c9c2-5e81-4984-9bd9-1ad940439668 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:08.923569 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-b5a6c9c2-5e81-4984-9bd9-1ad940439668 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:08.930647 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b5a6c9c2-5e81-4984-9bd9-1ad940439668 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4" status: 200 len: 1317 microversion: 2.1 time: 0.151382 Oct 19 08:26:08.931204 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 209/415] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:08 2021] GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:08.935667 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ff84fee5-86f9-46e6-939b-9e9858ff2ec1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:08.936248 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ff84fee5-86f9-46e6-939b-9e9858ff2ec1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 4bd61122-7096-461a-95b1-adc1dea18a0c] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:08.942065 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ff84fee5-86f9-46e6-939b-9e9858ff2ec1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:08.942643 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ff84fee5-86f9-46e6-939b-9e9858ff2ec1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:08.943450 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ff84fee5-86f9-46e6-939b-9e9858ff2ec1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:08.943885 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ff84fee5-86f9-46e6-939b-9e9858ff2ec1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:09.067566 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ff84fee5-86f9-46e6-939b-9e9858ff2ec1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:09.074736 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ff84fee5-86f9-46e6-939b-9e9858ff2ec1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c" status: 200 len: 1318 microversion: 2.1 time: 0.142409 Oct 19 08:26:09.075293 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 210/416] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:08 2021] GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:09.079763 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-5c6a2e96-8215-4e8d-9d95-04229b03b1a0 req-30daa1bb-02b9-478a-9d13-46a63f316682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bd61122-7096-461a-95b1-adc1dea18a0c", "name": "network-vif-plugged", "status": "completed", "tag": "6a155696-ac5e-466f-9258-1a6e5fa773b5"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:09.081296 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:26:09.081296 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:26:09.088154 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-5c6a2e96-8215-4e8d-9d95-04229b03b1a0 req-30daa1bb-02b9-478a-9d13-46a63f316682 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:09.088588 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-5c6a2e96-8215-4e8d-9d95-04229b03b1a0 req-30daa1bb-02b9-478a-9d13-46a63f316682 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:09.099268 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-5c6a2e96-8215-4e8d-9d95-04229b03b1a0 req-30daa1bb-02b9-478a-9d13-46a63f316682 service nova] Creating event network-vif-plugged:6a155696-ac5e-466f-9258-1a6e5fa773b5 for instance 4bd61122-7096-461a-95b1-adc1dea18a0c on hv-cinder-81398 Oct 19 08:26:09.104085 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-5c6a2e96-8215-4e8d-9d95-04229b03b1a0 req-30daa1bb-02b9-478a-9d13-46a63f316682 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027710 Oct 19 08:26:09.104651 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 211/417] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:26:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:26:09.109833 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c7c1e6dc-4d05-47b3-8514-1e989ba27f5e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:09.110535 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c7c1e6dc-4d05-47b3-8514-1e989ba27f5e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:09.116318 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c7c1e6dc-4d05-47b3-8514-1e989ba27f5e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:09.116762 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c7c1e6dc-4d05-47b3-8514-1e989ba27f5e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:09.117519 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c7c1e6dc-4d05-47b3-8514-1e989ba27f5e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:09.117948 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c7c1e6dc-4d05-47b3-8514-1e989ba27f5e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:09.235354 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-c7c1e6dc-4d05-47b3-8514-1e989ba27f5e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:09.242577 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c7c1e6dc-4d05-47b3-8514-1e989ba27f5e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.136810 Oct 19 08:26:09.243137 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 212/418] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:09 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:09.789155 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a6cdf879-c07f-4fd6-95d5-1237a0fe79b9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:09.790036 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a6cdf879-c07f-4fd6-95d5-1237a0fe79b9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:09.797285 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a6cdf879-c07f-4fd6-95d5-1237a0fe79b9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:09.797818 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a6cdf879-c07f-4fd6-95d5-1237a0fe79b9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:09.798752 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a6cdf879-c07f-4fd6-95d5-1237a0fe79b9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:09.799159 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a6cdf879-c07f-4fd6-95d5-1237a0fe79b9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:11.669493 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-3612f18a-c39b-438c-b81c-d2c9208e650c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28212 microversion: 2.20 time: 3.596060 Oct 19 08:26:11.670135 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 207/419] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:08 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28212 bytes in 3597 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:26:11.675042 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8f7efcf2-fbe6-4a88-8cb8-a2489c70c5c5 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:11.675728 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-8f7efcf2-fbe6-4a88-8cb8-a2489c70c5c5 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: 61889472-0e20-46bc-94d3-c4c42883a5b4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:11.682076 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8f7efcf2-fbe6-4a88-8cb8-a2489c70c5c5 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:11.682545 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8f7efcf2-fbe6-4a88-8cb8-a2489c70c5c5 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:11.683332 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8f7efcf2-fbe6-4a88-8cb8-a2489c70c5c5 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:11.683771 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8f7efcf2-fbe6-4a88-8cb8-a2489c70c5c5 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:11.688427 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a6cdf879-c07f-4fd6-95d5-1237a0fe79b9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28035 microversion: 2.1 time: 1.902813 Oct 19 08:26:11.689087 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 213/420] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:09 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28035 bytes in 1904 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:26:11.694400 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-dca37c86-ef0b-4ba1-9983-829d1074c739 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:11.695103 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-dca37c86-ef0b-4ba1-9983-829d1074c739 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 4bd61122-7096-461a-95b1-adc1dea18a0c] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:11.702365 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-dca37c86-ef0b-4ba1-9983-829d1074c739 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:11.702873 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-dca37c86-ef0b-4ba1-9983-829d1074c739 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:11.703632 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-dca37c86-ef0b-4ba1-9983-829d1074c739 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:11.704052 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-dca37c86-ef0b-4ba1-9983-829d1074c739 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:11.933635 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-8f7efcf2-fbe6-4a88-8cb8-a2489c70c5c5 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:11.942767 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-8f7efcf2-fbe6-4a88-8cb8-a2489c70c5c5 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4" status: 200 len: 1317 microversion: 2.1 time: 0.271285 Oct 19 08:26:11.943347 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 208/421] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:11 2021] GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:11.945463 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-dca37c86-ef0b-4ba1-9983-829d1074c739 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:11.951883 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-1bfde0be-7d59-4318-a8e0-b025548d927b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:11.952999 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-1bfde0be-7d59-4318-a8e0-b025548d927b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:11.957557 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-dca37c86-ef0b-4ba1-9983-829d1074c739 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c" status: 200 len: 1318 microversion: 2.1 time: 0.267050 Oct 19 08:26:11.968370 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 214/422] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:11 2021] GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:11.969410 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1bfde0be-7d59-4318-a8e0-b025548d927b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:11.970200 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1bfde0be-7d59-4318-a8e0-b025548d927b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:11.976646 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1bfde0be-7d59-4318-a8e0-b025548d927b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:11.977116 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1bfde0be-7d59-4318-a8e0-b025548d927b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:12.003567 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-72a1cf04-69f1-4b7f-8492-07d5e53dd1c9 req-50a71f97-a35b-4456-b622-f248bc70725b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61889472-0e20-46bc-94d3-c4c42883a5b4", "name": "network-vif-plugged", "status": "completed", "tag": "a4cb6d5a-dee1-4c5d-802a-33281ff7b5a1"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:12.005580 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:26:12.005580 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:26:12.015773 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-72a1cf04-69f1-4b7f-8492-07d5e53dd1c9 req-50a71f97-a35b-4456-b622-f248bc70725b service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:12.016541 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-72a1cf04-69f1-4b7f-8492-07d5e53dd1c9 req-50a71f97-a35b-4456-b622-f248bc70725b service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:12.034745 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-72a1cf04-69f1-4b7f-8492-07d5e53dd1c9 req-50a71f97-a35b-4456-b622-f248bc70725b service nova] Creating event network-vif-plugged:a4cb6d5a-dee1-4c5d-802a-33281ff7b5a1 for instance 61889472-0e20-46bc-94d3-c4c42883a5b4 on hv-cinder-81398 Oct 19 08:26:12.041612 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-72a1cf04-69f1-4b7f-8492-07d5e53dd1c9 req-50a71f97-a35b-4456-b622-f248bc70725b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041622 Oct 19 08:26:12.043291 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 215/423] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:26:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 08:26:12.117841 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-1bfde0be-7d59-4318-a8e0-b025548d927b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:12.125662 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-1bfde0be-7d59-4318-a8e0-b025548d927b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.180752 Oct 19 08:26:12.126214 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 209/424] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:11 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:12.681789 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-eefdbb13-c9b7-43c7-975d-c711104c0277 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:12.682909 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-eefdbb13-c9b7-43c7-975d-c711104c0277 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:12.688817 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-eefdbb13-c9b7-43c7-975d-c711104c0277 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:12.689378 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-eefdbb13-c9b7-43c7-975d-c711104c0277 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:12.690009 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-eefdbb13-c9b7-43c7-975d-c711104c0277 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:12.690437 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-eefdbb13-c9b7-43c7-975d-c711104c0277 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:12.699964 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-47094ec7-05d6-43e1-97b8-3f7b18d47ba1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:12.700917 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-47094ec7-05d6-43e1-97b8-3f7b18d47ba1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:12.707453 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-47094ec7-05d6-43e1-97b8-3f7b18d47ba1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:12.707884 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-47094ec7-05d6-43e1-97b8-3f7b18d47ba1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:12.708661 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-47094ec7-05d6-43e1-97b8-3f7b18d47ba1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:12.709090 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-47094ec7-05d6-43e1-97b8-3f7b18d47ba1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:12.873766 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-eefdbb13-c9b7-43c7-975d-c711104c0277 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28212 microversion: 2.20 time: 0.196160 Oct 19 08:26:12.877688 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 216/425] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:12 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28212 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:12.901592 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-47094ec7-05d6-43e1-97b8-3f7b18d47ba1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28152 microversion: 2.1 time: 0.204988 Oct 19 08:26:12.906169 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 210/426] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:12 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28152 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:26:12.960826 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-765dd9a0-0057-4fda-8bb3-113bb00f5efe tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:12.961433 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-765dd9a0-0057-4fda-8bb3-113bb00f5efe tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: 61889472-0e20-46bc-94d3-c4c42883a5b4] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:12.968972 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-765dd9a0-0057-4fda-8bb3-113bb00f5efe tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:12.969486 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-765dd9a0-0057-4fda-8bb3-113bb00f5efe tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:12.970480 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-765dd9a0-0057-4fda-8bb3-113bb00f5efe tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:12.971595 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-765dd9a0-0057-4fda-8bb3-113bb00f5efe tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:12.976887 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-7831f003-225b-483e-821a-4081351e48c1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:12.977582 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-7831f003-225b-483e-821a-4081351e48c1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 4bd61122-7096-461a-95b1-adc1dea18a0c] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:12.992817 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7831f003-225b-483e-821a-4081351e48c1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:12.993269 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7831f003-225b-483e-821a-4081351e48c1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:12.994053 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7831f003-225b-483e-821a-4081351e48c1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:12.994481 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7831f003-225b-483e-821a-4081351e48c1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:13.175430 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-765dd9a0-0057-4fda-8bb3-113bb00f5efe tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:13.180903 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-7831f003-225b-483e-821a-4081351e48c1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:13.186205 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-765dd9a0-0057-4fda-8bb3-113bb00f5efe tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4" status: 200 len: 1317 microversion: 2.1 time: 0.228174 Oct 19 08:26:13.187555 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 217/427] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:12 2021] GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4 => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:13.192017 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ec30f472-cdde-4563-87b7-03e19f17d7f7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:13.192605 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ec30f472-cdde-4563-87b7-03e19f17d7f7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:13.199067 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ec30f472-cdde-4563-87b7-03e19f17d7f7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:13.199646 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ec30f472-cdde-4563-87b7-03e19f17d7f7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:13.200531 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ec30f472-cdde-4563-87b7-03e19f17d7f7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:13.201189 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ec30f472-cdde-4563-87b7-03e19f17d7f7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:13.203901 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-7831f003-225b-483e-821a-4081351e48c1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c" status: 200 len: 1318 microversion: 2.1 time: 0.232697 Oct 19 08:26:13.204698 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 211/428] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:12 2021] GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:13.352061 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ec30f472-cdde-4563-87b7-03e19f17d7f7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:13.360703 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ec30f472-cdde-4563-87b7-03e19f17d7f7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.171760 Oct 19 08:26:13.361976 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 218/429] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:13 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:13.885214 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-e2bf618b-db29-4c47-8d18-617a107e3d87 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:13.886182 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-e2bf618b-db29-4c47-8d18-617a107e3d87 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:13.892569 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e2bf618b-db29-4c47-8d18-617a107e3d87 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:13.893001 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e2bf618b-db29-4c47-8d18-617a107e3d87 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:13.893751 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e2bf618b-db29-4c47-8d18-617a107e3d87 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:13.894174 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e2bf618b-db29-4c47-8d18-617a107e3d87 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:13.913517 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-cfc56f6e-9bb3-4da0-a9ff-d8a5df268de8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:13.914474 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-cfc56f6e-9bb3-4da0-a9ff-d8a5df268de8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:13.922562 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cfc56f6e-9bb3-4da0-a9ff-d8a5df268de8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:13.922562 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cfc56f6e-9bb3-4da0-a9ff-d8a5df268de8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:13.922562 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cfc56f6e-9bb3-4da0-a9ff-d8a5df268de8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:13.922562 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cfc56f6e-9bb3-4da0-a9ff-d8a5df268de8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:14.013707 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-e2bf618b-db29-4c47-8d18-617a107e3d87 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28212 microversion: 2.20 time: 0.131982 Oct 19 08:26:14.015470 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 212/430] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:13 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28212 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:14.025969 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-cfc56f6e-9bb3-4da0-a9ff-d8a5df268de8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28152 microversion: 2.1 time: 0.115944 Oct 19 08:26:14.026751 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 219/431] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:13 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28152 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:26:14.205628 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-f9adbc78-8f88-47a0-a2ef-9349278777d2 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:14.206333 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-f9adbc78-8f88-47a0-a2ef-9349278777d2 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: 61889472-0e20-46bc-94d3-c4c42883a5b4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:14.212724 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f9adbc78-8f88-47a0-a2ef-9349278777d2 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:14.213157 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f9adbc78-8f88-47a0-a2ef-9349278777d2 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:14.213905 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f9adbc78-8f88-47a0-a2ef-9349278777d2 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:14.214329 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f9adbc78-8f88-47a0-a2ef-9349278777d2 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:14.221436 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-39ca31c0-1294-4d4a-862c-32cd80add20c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:14.222118 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-39ca31c0-1294-4d4a-862c-32cd80add20c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 4bd61122-7096-461a-95b1-adc1dea18a0c] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:14.228457 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-39ca31c0-1294-4d4a-862c-32cd80add20c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:14.228893 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-39ca31c0-1294-4d4a-862c-32cd80add20c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:14.229647 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-39ca31c0-1294-4d4a-862c-32cd80add20c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:14.230065 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-39ca31c0-1294-4d4a-862c-32cd80add20c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:14.406782 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-f9adbc78-8f88-47a0-a2ef-9349278777d2 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:14.416671 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-f9adbc78-8f88-47a0-a2ef-9349278777d2 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4" status: 200 len: 1317 microversion: 2.1 time: 0.215546 Oct 19 08:26:14.426457 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-39ca31c0-1294-4d4a-862c-32cd80add20c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:14.427032 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 213/432] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:14 2021] GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4 => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:14.429358 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-39ca31c0-1294-4d4a-862c-32cd80add20c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c" status: 200 len: 1508 microversion: 2.1 time: 0.212451 Oct 19 08:26:14.430448 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 220/433] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:14 2021] GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c => generated 1508 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:14.431763 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-7cc51048-1e57-4c9b-82e9-4d51eeac5459 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:14.432365 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-7cc51048-1e57-4c9b-82e9-4d51eeac5459 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:14.438873 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7cc51048-1e57-4c9b-82e9-4d51eeac5459 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:14.439308 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7cc51048-1e57-4c9b-82e9-4d51eeac5459 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:14.440067 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7cc51048-1e57-4c9b-82e9-4d51eeac5459 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:14.440495 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7cc51048-1e57-4c9b-82e9-4d51eeac5459 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:14.447532 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-6ee91054-ef1b-42ce-811e-d2bfbbf0b51c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8bc2a98-753f-4f19-a59d-9c8a0b6ecd86"}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:14.449705 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-6ee91054-ef1b-42ce-811e-d2bfbbf0b51c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 4bd61122-7096-461a-95b1-adc1dea18a0c] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:14.456556 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6ee91054-ef1b-42ce-811e-d2bfbbf0b51c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:14.457333 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6ee91054-ef1b-42ce-811e-d2bfbbf0b51c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:14.458111 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6ee91054-ef1b-42ce-811e-d2bfbbf0b51c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:14.460492 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6ee91054-ef1b-42ce-811e-d2bfbbf0b51c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:14.542573 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.wsgi [None req-6ee91054-ef1b-42ce-811e-d2bfbbf0b51c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] HTTP exception thrown: Invalid volume: volume d8bc2a98-753f-4f19-a59d-9c8a0b6ecd86 is already attached to instances: b75e6c63-1b3e-4a9c-adbc-9db31920288f Oct 19 08:26:14.543175 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-6ee91054-ef1b-42ce-811e-d2bfbbf0b51c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Returning 400 to user: Invalid volume: volume d8bc2a98-753f-4f19-a59d-9c8a0b6ecd86 is already attached to instances: b75e6c63-1b3e-4a9c-adbc-9db31920288f {{(pid=114106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:26:14.544003 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-6ee91054-ef1b-42ce-811e-d2bfbbf0b51c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "POST /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100342 Oct 19 08:26:14.544722 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 221/434] 10.222.0.26 () {60 vars in 1322 bytes} [Tue Oct 19 08:26:14 2021] POST /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 08:26:14.579033 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-7cc51048-1e57-4c9b-82e9-4d51eeac5459 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:14.587961 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-7cc51048-1e57-4c9b-82e9-4d51eeac5459 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.159724 Oct 19 08:26:14.597736 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 214/435] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:14 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:14.613385 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ddbae418-6348-4264-aa86-323e1f84c8fb tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:14.614116 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ddbae418-6348-4264-aa86-323e1f84c8fb tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:14.620312 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ddbae418-6348-4264-aa86-323e1f84c8fb tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:14.620844 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ddbae418-6348-4264-aa86-323e1f84c8fb tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:14.621671 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ddbae418-6348-4264-aa86-323e1f84c8fb tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:14.622185 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ddbae418-6348-4264-aa86-323e1f84c8fb tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:14.791439 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.objects.instance [None req-ddbae418-6348-4264-aa86-323e1f84c8fb tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lazy-loading 'services' on Instance uuid b75e6c63-1b3e-4a9c-adbc-9db31920288f {{(pid=114106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 19 08:26:14.924824 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ddbae418-6348-4264-aa86-323e1f84c8fb tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f/os-volume_attachments/d8bc2a98-753f-4f19-a59d-9c8a0b6ecd86" status: 202 len: 0 microversion: 2.1 time: 0.314920 Oct 19 08:26:14.928649 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 222/436] 10.222.0.26 () {58 vars in 1415 bytes} [Tue Oct 19 08:26:14 2021] DELETE /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f/os-volume_attachments/d8bc2a98-753f-4f19-a59d-9c8a0b6ecd86 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:14.933611 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-ad69a229-325e-4353-8680-8144180975ec tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:14.934578 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-ad69a229-325e-4353-8680-8144180975ec tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:14.942182 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ad69a229-325e-4353-8680-8144180975ec tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:14.942665 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ad69a229-325e-4353-8680-8144180975ec tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:14.943495 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ad69a229-325e-4353-8680-8144180975ec tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:14.943948 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ad69a229-325e-4353-8680-8144180975ec tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:14.980461 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-ad69a229-325e-4353-8680-8144180975ec tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050439 Oct 19 08:26:14.981018 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 215/437] 10.222.0.26 () {58 vars in 1301 bytes} [Tue Oct 19 08:26:14 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:26:15.025921 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ec9e67c4-39e5-42f6-9d75-497185d0b636 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:15.027009 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ec9e67c4-39e5-42f6-9d75-497185d0b636 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:15.033344 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ec9e67c4-39e5-42f6-9d75-497185d0b636 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:15.033608 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ec9e67c4-39e5-42f6-9d75-497185d0b636 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:15.034532 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ec9e67c4-39e5-42f6-9d75-497185d0b636 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:15.034938 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ec9e67c4-39e5-42f6-9d75-497185d0b636 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:15.038754 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-6271bc1f-4d88-4ba7-b8c5-8276142d98b1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:15.039675 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-6271bc1f-4d88-4ba7-b8c5-8276142d98b1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:15.046286 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6271bc1f-4d88-4ba7-b8c5-8276142d98b1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:15.046914 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6271bc1f-4d88-4ba7-b8c5-8276142d98b1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:15.047693 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6271bc1f-4d88-4ba7-b8c5-8276142d98b1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:15.048129 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6271bc1f-4d88-4ba7-b8c5-8276142d98b1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:15.105618 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ec9e67c4-39e5-42f6-9d75-497185d0b636 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28212 microversion: 2.20 time: 0.083427 Oct 19 08:26:15.106256 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 223/438] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:15 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28212 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:15.134927 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-6271bc1f-4d88-4ba7-b8c5-8276142d98b1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28152 microversion: 2.1 time: 0.099467 Oct 19 08:26:15.135698 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 216/439] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:15 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28152 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:26:15.434369 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b5211417-e8f9-4964-9dbd-df9d207cee74 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:15.435491 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b5211417-e8f9-4964-9dbd-df9d207cee74 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: 61889472-0e20-46bc-94d3-c4c42883a5b4] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:15.443789 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b5211417-e8f9-4964-9dbd-df9d207cee74 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:15.444238 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b5211417-e8f9-4964-9dbd-df9d207cee74 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:15.445180 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b5211417-e8f9-4964-9dbd-df9d207cee74 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:15.445606 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b5211417-e8f9-4964-9dbd-df9d207cee74 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:15.575973 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-b5211417-e8f9-4964-9dbd-df9d207cee74 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:15.584777 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b5211417-e8f9-4964-9dbd-df9d207cee74 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4" status: 200 len: 1506 microversion: 2.1 time: 0.154874 Oct 19 08:26:15.585337 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 224/440] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:15 2021] GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:15.605111 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-699f26a0-9d25-4e51-963d-4261b8a8de39 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:15.606518 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-699f26a0-9d25-4e51-963d-4261b8a8de39 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:15.613653 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-699f26a0-9d25-4e51-963d-4261b8a8de39 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:15.614299 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-699f26a0-9d25-4e51-963d-4261b8a8de39 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:15.615130 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-699f26a0-9d25-4e51-963d-4261b8a8de39 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:15.615563 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-699f26a0-9d25-4e51-963d-4261b8a8de39 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:15.747511 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-699f26a0-9d25-4e51-963d-4261b8a8de39 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:15.756494 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-699f26a0-9d25-4e51-963d-4261b8a8de39 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.155220 Oct 19 08:26:15.757121 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 217/441] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:15 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:15.996345 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-31c40188-737c-4160-a150-23eadbc52aad tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:15.997852 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-31c40188-737c-4160-a150-23eadbc52aad tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:16.007802 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-31c40188-737c-4160-a150-23eadbc52aad tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:16.008553 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-31c40188-737c-4160-a150-23eadbc52aad tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:16.009830 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-31c40188-737c-4160-a150-23eadbc52aad tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:16.010455 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-31c40188-737c-4160-a150-23eadbc52aad tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:16.083293 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-31c40188-737c-4160-a150-23eadbc52aad tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085171 Oct 19 08:26:16.083293 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 225/442] 10.222.0.26 () {58 vars in 1301 bytes} [Tue Oct 19 08:26:15 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 08:26:16.117553 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-344bb884-6140-4454-b81e-e925904f27a4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:16.118588 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-344bb884-6140-4454-b81e-e925904f27a4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:16.124588 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-344bb884-6140-4454-b81e-e925904f27a4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:16.125036 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-344bb884-6140-4454-b81e-e925904f27a4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:16.125813 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-344bb884-6140-4454-b81e-e925904f27a4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:16.126575 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-344bb884-6140-4454-b81e-e925904f27a4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:16.149098 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-7ce07d23-4675-4a76-9a28-b34abc9db0c0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:16.150230 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-7ce07d23-4675-4a76-9a28-b34abc9db0c0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:16.160464 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7ce07d23-4675-4a76-9a28-b34abc9db0c0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:16.160953 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7ce07d23-4675-4a76-9a28-b34abc9db0c0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:16.161792 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7ce07d23-4675-4a76-9a28-b34abc9db0c0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:16.162322 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7ce07d23-4675-4a76-9a28-b34abc9db0c0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:16.199968 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-344bb884-6140-4454-b81e-e925904f27a4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28212 microversion: 2.20 time: 0.085924 Oct 19 08:26:16.200977 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 218/443] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:16 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28212 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:16.237071 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-7ce07d23-4675-4a76-9a28-b34abc9db0c0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28152 microversion: 2.1 time: 0.093174 Oct 19 08:26:16.238222 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 226/444] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:16 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28152 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:26:16.244837 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2ca63d88-bb69-416a-8586-9e92d80c9b09 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-907311422", "imageRef": "9102a998-a580-4b4e-b6a1-3172273dd66d", "flavorRef": "452", "networks": [{"uuid": "fbed0243-7d71-4fc4-9caf-afbd08f9b31f"}]}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:16.305377 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.network.neutron [None req-2ca63d88-bb69-416a-8586-9e92d80c9b09 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] validate_networks() for [('fbed0243-7d71-4fc4-9caf-afbd08f9b31f', None, None, None, None, None)] {{(pid=114105) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 19 08:26:16.690784 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-2ca63d88-bb69-416a-8586-9e92d80c9b09 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Flavor limits 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 08:26:16.691205 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-2ca63d88-bb69-416a-8586-9e92d80c9b09 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Image limits 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 08:26:16.691676 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-2ca63d88-bb69-416a-8586-9e92d80c9b09 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Flavor pref 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 08:26:16.692079 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-2ca63d88-bb69-416a-8586-9e92d80c9b09 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Image pref 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 08:26:16.692486 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-2ca63d88-bb69-416a-8586-9e92d80c9b09 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 08:26:16.700899 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2ca63d88-bb69-416a-8586-9e92d80c9b09 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:16.701340 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2ca63d88-bb69-416a-8586-9e92d80c9b09 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:16.702859 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2ca63d88-bb69-416a-8586-9e92d80c9b09 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:16.703289 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2ca63d88-bb69-416a-8586-9e92d80c9b09 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:16.719876 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-2ca63d88-bb69-416a-8586-9e92d80c9b09 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Getting quotas for project d1e6b0972cf140649ed2cad14f2db0b4. Resources: {'cores', 'instances', 'ram'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:26:16.723719 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-2ca63d88-bb69-416a-8586-9e92d80c9b09 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Getting quotas for user bb3db95dc956487ead5e579b58451580 and project d1e6b0972cf140649ed2cad14f2db0b4. Resources: {'cores', 'instances', 'ram'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:26:16.734231 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2ca63d88-bb69-416a-8586-9e92d80c9b09 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Going to run 1 instances... {{(pid=114105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 19 08:26:16.736642 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2ca63d88-bb69-416a-8586-9e92d80c9b09 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9102a998-a580-4b4e-b6a1-3172273dd66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 19 08:26:16.775214 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-44ef59f2-06fd-420a-99d5-9218822d1525 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:16.775917 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-44ef59f2-06fd-420a-99d5-9218822d1525 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:16.784054 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-44ef59f2-06fd-420a-99d5-9218822d1525 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:16.784758 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-44ef59f2-06fd-420a-99d5-9218822d1525 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:16.785718 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2ca63d88-bb69-416a-8586-9e92d80c9b09 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.544621 Oct 19 08:26:16.785882 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-44ef59f2-06fd-420a-99d5-9218822d1525 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:16.786373 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 219/445] 10.222.0.26 () {60 vars in 1146 bytes} [Tue Oct 19 08:26:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 08:26:16.786635 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-44ef59f2-06fd-420a-99d5-9218822d1525 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:16.797216 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-75dd842c-af9e-4a84-a55f-37470d618ecb tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:16.797899 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-75dd842c-af9e-4a84-a55f-37470d618ecb tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:16.877571 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-75dd842c-af9e-4a84-a55f-37470d618ecb tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:16.884482 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-75dd842c-af9e-4a84-a55f-37470d618ecb tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1217 microversion: 2.1 time: 0.091774 Oct 19 08:26:16.885442 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 220/446] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:16 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:16.937913 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-44ef59f2-06fd-420a-99d5-9218822d1525 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:16.945576 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-44ef59f2-06fd-420a-99d5-9218822d1525 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.175647 Oct 19 08:26:16.946126 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 227/447] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:16 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:26:17.211555 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-85294376-d18c-437e-ba7c-f59aa126ca92 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:17.212548 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-85294376-d18c-437e-ba7c-f59aa126ca92 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:17.220122 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-85294376-d18c-437e-ba7c-f59aa126ca92 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:17.220561 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-85294376-d18c-437e-ba7c-f59aa126ca92 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:17.221322 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-85294376-d18c-437e-ba7c-f59aa126ca92 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:17.221743 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-85294376-d18c-437e-ba7c-f59aa126ca92 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:17.248834 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ad2b55d5-f7ab-402a-860c-0b5be61add09 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:17.250070 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ad2b55d5-f7ab-402a-860c-0b5be61add09 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:17.256247 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ad2b55d5-f7ab-402a-860c-0b5be61add09 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:17.256680 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ad2b55d5-f7ab-402a-860c-0b5be61add09 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:17.257423 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ad2b55d5-f7ab-402a-860c-0b5be61add09 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:17.257845 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ad2b55d5-f7ab-402a-860c-0b5be61add09 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:17.329759 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-85294376-d18c-437e-ba7c-f59aa126ca92 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28212 microversion: 2.20 time: 0.121700 Oct 19 08:26:17.333615 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 221/448] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:17 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28212 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:17.347770 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ad2b55d5-f7ab-402a-860c-0b5be61add09 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28152 microversion: 2.1 time: 0.102818 Oct 19 08:26:17.348996 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 228/449] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:17 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28152 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:26:17.903486 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-27308fdb-7dba-486b-8c8a-f38008f661b0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:17.904206 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-27308fdb-7dba-486b-8c8a-f38008f661b0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:17.912615 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-27308fdb-7dba-486b-8c8a-f38008f661b0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:17.913354 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-27308fdb-7dba-486b-8c8a-f38008f661b0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:17.914431 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-27308fdb-7dba-486b-8c8a-f38008f661b0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:17.915161 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-27308fdb-7dba-486b-8c8a-f38008f661b0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:17.964707 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-1b1bf911-8324-4430-bfc3-38719c5562dd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:17.965646 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-1b1bf911-8324-4430-bfc3-38719c5562dd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:17.975381 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1b1bf911-8324-4430-bfc3-38719c5562dd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:17.975829 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1b1bf911-8324-4430-bfc3-38719c5562dd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:17.976602 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1b1bf911-8324-4430-bfc3-38719c5562dd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:17.979171 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1b1bf911-8324-4430-bfc3-38719c5562dd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:18.030485 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-27308fdb-7dba-486b-8c8a-f38008f661b0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:18.043040 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-27308fdb-7dba-486b-8c8a-f38008f661b0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1275 microversion: 2.1 time: 0.143805 Oct 19 08:26:18.050896 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 222/450] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:17 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1275 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:18.214001 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-1b1bf911-8324-4430-bfc3-38719c5562dd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:18.224101 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-1b1bf911-8324-4430-bfc3-38719c5562dd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.264220 Oct 19 08:26:18.225480 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 229/451] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:17 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:18.340426 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-556f539f-1569-4b6d-848a-31eecce319e8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:18.341340 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-556f539f-1569-4b6d-848a-31eecce319e8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:18.347199 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-556f539f-1569-4b6d-848a-31eecce319e8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:18.347644 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-556f539f-1569-4b6d-848a-31eecce319e8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:18.348408 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-556f539f-1569-4b6d-848a-31eecce319e8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:18.348843 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-556f539f-1569-4b6d-848a-31eecce319e8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:18.360007 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-65b80e69-29e9-4e77-bf94-8cd1732f7725 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:18.360915 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-65b80e69-29e9-4e77-bf94-8cd1732f7725 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:18.367013 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-65b80e69-29e9-4e77-bf94-8cd1732f7725 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:18.367450 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-65b80e69-29e9-4e77-bf94-8cd1732f7725 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:18.368399 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-65b80e69-29e9-4e77-bf94-8cd1732f7725 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:18.368984 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-65b80e69-29e9-4e77-bf94-8cd1732f7725 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:18.414728 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-556f539f-1569-4b6d-848a-31eecce319e8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28212 microversion: 2.20 time: 0.077565 Oct 19 08:26:18.415443 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 223/452] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:18 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:18.470065 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-65b80e69-29e9-4e77-bf94-8cd1732f7725 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28152 microversion: 2.1 time: 0.113465 Oct 19 08:26:18.473716 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 230/453] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:18 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28152 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:26:19.060486 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c439a9ab-1f9d-494b-a5fa-cb4e8ec82574 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:19.061685 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-c439a9ab-1f9d-494b-a5fa-cb4e8ec82574 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:19.068087 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c439a9ab-1f9d-494b-a5fa-cb4e8ec82574 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:19.068521 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c439a9ab-1f9d-494b-a5fa-cb4e8ec82574 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:19.069303 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c439a9ab-1f9d-494b-a5fa-cb4e8ec82574 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:19.069758 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c439a9ab-1f9d-494b-a5fa-cb4e8ec82574 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:19.189416 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-b93952fd-089f-410c-b148-fd3e882a5f01 req-bc1255c6-9add-4be4-9fdc-50911cfed559 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b35fc67b-52d9-4e8f-a8a5-27826b508f1b", "tag": "e2b9fad3-3c12-4fab-ad0c-19ed2c6d2451"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:19.191425 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:26:19.191425 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:26:19.200522 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-b93952fd-089f-410c-b148-fd3e882a5f01 req-bc1255c6-9add-4be4-9fdc-50911cfed559 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:19.201295 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-b93952fd-089f-410c-b148-fd3e882a5f01 req-bc1255c6-9add-4be4-9fdc-50911cfed559 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:19.214155 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-b93952fd-089f-410c-b148-fd3e882a5f01 req-bc1255c6-9add-4be4-9fdc-50911cfed559 service nova] Creating event network-changed:e2b9fad3-3c12-4fab-ad0c-19ed2c6d2451 for instance b35fc67b-52d9-4e8f-a8a5-27826b508f1b on hv-cinder-81398 Oct 19 08:26:19.219739 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-b93952fd-089f-410c-b148-fd3e882a5f01 req-bc1255c6-9add-4be4-9fdc-50911cfed559 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035518 Oct 19 08:26:19.220447 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 231/454] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:26:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 08:26:19.247155 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-807b3874-2ce7-47c4-9dc6-dbd0a70186a6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:19.247915 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-807b3874-2ce7-47c4-9dc6-dbd0a70186a6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:19.262585 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-807b3874-2ce7-47c4-9dc6-dbd0a70186a6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:19.262585 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-807b3874-2ce7-47c4-9dc6-dbd0a70186a6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:19.262585 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-807b3874-2ce7-47c4-9dc6-dbd0a70186a6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:19.262585 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-807b3874-2ce7-47c4-9dc6-dbd0a70186a6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:19.288689 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-c439a9ab-1f9d-494b-a5fa-cb4e8ec82574 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:19.296413 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-c439a9ab-1f9d-494b-a5fa-cb4e8ec82574 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1317 microversion: 2.1 time: 0.239769 Oct 19 08:26:19.297157 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 224/455] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:19 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:19.427734 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-46004e2d-e823-4e03-b20f-71f0d1800a7a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:19.428673 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-46004e2d-e823-4e03-b20f-71f0d1800a7a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:19.434380 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-46004e2d-e823-4e03-b20f-71f0d1800a7a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:19.434859 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-46004e2d-e823-4e03-b20f-71f0d1800a7a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:19.435618 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-46004e2d-e823-4e03-b20f-71f0d1800a7a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:19.436630 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-46004e2d-e823-4e03-b20f-71f0d1800a7a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:19.456187 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-807b3874-2ce7-47c4-9dc6-dbd0a70186a6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:19.463714 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-807b3874-2ce7-47c4-9dc6-dbd0a70186a6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.223866 Oct 19 08:26:19.464406 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 232/456] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:19 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:19.480934 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a8add087-f6cd-442e-9f5f-9d5da08b683a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:19.482095 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a8add087-f6cd-442e-9f5f-9d5da08b683a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:19.488587 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a8add087-f6cd-442e-9f5f-9d5da08b683a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:19.489104 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a8add087-f6cd-442e-9f5f-9d5da08b683a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:19.489898 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a8add087-f6cd-442e-9f5f-9d5da08b683a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:19.490323 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a8add087-f6cd-442e-9f5f-9d5da08b683a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:19.511584 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-46004e2d-e823-4e03-b20f-71f0d1800a7a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28212 microversion: 2.20 time: 0.087392 Oct 19 08:26:19.512957 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 225/457] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:19 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28212 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:26:19.552738 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a8add087-f6cd-442e-9f5f-9d5da08b683a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28152 microversion: 2.1 time: 0.075139 Oct 19 08:26:19.556527 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 233/458] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:19 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28152 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:26:20.313284 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-dc927728-b8b2-4b8a-9bfb-d10768740198 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:20.313964 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-dc927728-b8b2-4b8a-9bfb-d10768740198 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:20.320400 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dc927728-b8b2-4b8a-9bfb-d10768740198 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:20.320836 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dc927728-b8b2-4b8a-9bfb-d10768740198 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:20.321580 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dc927728-b8b2-4b8a-9bfb-d10768740198 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:20.322001 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dc927728-b8b2-4b8a-9bfb-d10768740198 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:20.446519 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-dc927728-b8b2-4b8a-9bfb-d10768740198 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:20.454452 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-dc927728-b8b2-4b8a-9bfb-d10768740198 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1317 microversion: 2.1 time: 0.145143 Oct 19 08:26:20.455025 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 226/459] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:20 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:20.481195 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-65092e8e-3ed9-4533-9ef3-5b8ed929c0b0 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:20.481881 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-65092e8e-3ed9-4533-9ef3-5b8ed929c0b0 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:20.488303 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-65092e8e-3ed9-4533-9ef3-5b8ed929c0b0 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:20.488746 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-65092e8e-3ed9-4533-9ef3-5b8ed929c0b0 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:20.489499 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-65092e8e-3ed9-4533-9ef3-5b8ed929c0b0 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:20.489931 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-65092e8e-3ed9-4533-9ef3-5b8ed929c0b0 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:20.523905 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-3268c243-8c2f-481c-bed4-a5c9cb69fe6d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:20.524894 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-3268c243-8c2f-481c-bed4-a5c9cb69fe6d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:20.531494 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3268c243-8c2f-481c-bed4-a5c9cb69fe6d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:20.532025 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3268c243-8c2f-481c-bed4-a5c9cb69fe6d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:20.532790 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3268c243-8c2f-481c-bed4-a5c9cb69fe6d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:20.533222 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3268c243-8c2f-481c-bed4-a5c9cb69fe6d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:20.598858 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-3268c243-8c2f-481c-bed4-a5c9cb69fe6d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28212 microversion: 2.20 time: 0.078285 Oct 19 08:26:20.599524 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 227/460] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:20 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:26:20.606477 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-bd993c1c-5615-44f4-8543-4e83830f99fd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:20.607474 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-bd993c1c-5615-44f4-8543-4e83830f99fd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:20.614115 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bd993c1c-5615-44f4-8543-4e83830f99fd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:20.614584 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bd993c1c-5615-44f4-8543-4e83830f99fd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:20.614917 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-65092e8e-3ed9-4533-9ef3-5b8ed929c0b0 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:20.615339 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bd993c1c-5615-44f4-8543-4e83830f99fd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:20.615761 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bd993c1c-5615-44f4-8543-4e83830f99fd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:20.622245 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-65092e8e-3ed9-4533-9ef3-5b8ed929c0b0 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.145010 Oct 19 08:26:20.622913 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 234/461] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:20 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:20.689333 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-bd993c1c-5615-44f4-8543-4e83830f99fd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28152 microversion: 2.1 time: 0.087153 Oct 19 08:26:20.689885 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 228/462] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:20 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28152 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:26:21.471787 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-aee4ef8a-e0f6-4db4-8a8a-1c8bf5c5b683 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:21.472325 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-aee4ef8a-e0f6-4db4-8a8a-1c8bf5c5b683 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:21.478194 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-aee4ef8a-e0f6-4db4-8a8a-1c8bf5c5b683 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:21.478670 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-aee4ef8a-e0f6-4db4-8a8a-1c8bf5c5b683 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:21.479440 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-aee4ef8a-e0f6-4db4-8a8a-1c8bf5c5b683 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:21.479865 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-aee4ef8a-e0f6-4db4-8a8a-1c8bf5c5b683 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:21.599687 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-aee4ef8a-e0f6-4db4-8a8a-1c8bf5c5b683 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:21.606874 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-aee4ef8a-e0f6-4db4-8a8a-1c8bf5c5b683 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1317 microversion: 2.1 time: 0.139684 Oct 19 08:26:21.607422 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 235/463] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:21 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1317 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:21.612435 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-1f449ce4-50b5-4b8c-8800-eb99b1efc67c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:21.613409 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-1f449ce4-50b5-4b8c-8800-eb99b1efc67c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:21.619390 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1f449ce4-50b5-4b8c-8800-eb99b1efc67c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:21.619840 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1f449ce4-50b5-4b8c-8800-eb99b1efc67c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:21.620611 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1f449ce4-50b5-4b8c-8800-eb99b1efc67c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:21.621033 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1f449ce4-50b5-4b8c-8800-eb99b1efc67c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:21.640110 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c2ae18f7-acb3-40f2-9d70-bec38b9c4992 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:21.640998 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c2ae18f7-acb3-40f2-9d70-bec38b9c4992 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:21.646698 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c2ae18f7-acb3-40f2-9d70-bec38b9c4992 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:21.647139 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c2ae18f7-acb3-40f2-9d70-bec38b9c4992 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:21.647901 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c2ae18f7-acb3-40f2-9d70-bec38b9c4992 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:21.648325 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c2ae18f7-acb3-40f2-9d70-bec38b9c4992 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:21.707167 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-1f449ce4-50b5-4b8c-8800-eb99b1efc67c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28212 microversion: 2.20 time: 0.100162 Oct 19 08:26:21.708630 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 229/464] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:21 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28212 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:26:21.712730 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-17de3aca-b77d-4710-a34e-ee172aa2d37d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:21.713708 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-17de3aca-b77d-4710-a34e-ee172aa2d37d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:21.720801 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-17de3aca-b77d-4710-a34e-ee172aa2d37d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:21.721249 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-17de3aca-b77d-4710-a34e-ee172aa2d37d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:21.722064 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-17de3aca-b77d-4710-a34e-ee172aa2d37d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:21.722436 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-17de3aca-b77d-4710-a34e-ee172aa2d37d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:21.781459 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-c2ae18f7-acb3-40f2-9d70-bec38b9c4992 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:21.788539 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c2ae18f7-acb3-40f2-9d70-bec38b9c4992 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.152479 Oct 19 08:26:21.789090 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 236/465] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:21 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:26:21.814405 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-17de3aca-b77d-4710-a34e-ee172aa2d37d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28152 microversion: 2.1 time: 0.105072 Oct 19 08:26:21.818302 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 230/466] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:21 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28152 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:26:22.624865 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-cfc0502f-bd96-4a15-a30e-4d46cff3d8dc tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:22.625465 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-cfc0502f-bd96-4a15-a30e-4d46cff3d8dc tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:22.631530 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cfc0502f-bd96-4a15-a30e-4d46cff3d8dc tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:22.631971 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cfc0502f-bd96-4a15-a30e-4d46cff3d8dc tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:22.632728 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cfc0502f-bd96-4a15-a30e-4d46cff3d8dc tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:22.633152 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cfc0502f-bd96-4a15-a30e-4d46cff3d8dc tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:22.720165 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-e45095ea-7b81-4be4-8ace-ce231ca435a4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:22.721157 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-e45095ea-7b81-4be4-8ace-ce231ca435a4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:22.727714 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e45095ea-7b81-4be4-8ace-ce231ca435a4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:22.728155 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e45095ea-7b81-4be4-8ace-ce231ca435a4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:22.728918 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e45095ea-7b81-4be4-8ace-ce231ca435a4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:22.729345 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e45095ea-7b81-4be4-8ace-ce231ca435a4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:22.752119 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-cfc0502f-bd96-4a15-a30e-4d46cff3d8dc tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:22.760690 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-cfc0502f-bd96-4a15-a30e-4d46cff3d8dc tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1317 microversion: 2.1 time: 0.139978 Oct 19 08:26:22.761350 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 237/467] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:22 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1317 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:22.805347 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-8116b657-e346-4379-8613-aa3ba2f82172 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:22.805937 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-8116b657-e346-4379-8613-aa3ba2f82172 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:22.813131 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8116b657-e346-4379-8613-aa3ba2f82172 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:22.813585 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8116b657-e346-4379-8613-aa3ba2f82172 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:22.814358 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8116b657-e346-4379-8613-aa3ba2f82172 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:22.814844 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8116b657-e346-4379-8613-aa3ba2f82172 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:22.816469 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-e45095ea-7b81-4be4-8ace-ce231ca435a4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28212 microversion: 2.20 time: 0.101074 Oct 19 08:26:22.817107 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 231/468] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:22 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28212 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:26:22.825857 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c4115041-6d86-4a39-b6c8-8a747e45821d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:22.826881 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-c4115041-6d86-4a39-b6c8-8a747e45821d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:22.833259 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c4115041-6d86-4a39-b6c8-8a747e45821d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:22.833704 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c4115041-6d86-4a39-b6c8-8a747e45821d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:22.834462 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c4115041-6d86-4a39-b6c8-8a747e45821d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:22.834913 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c4115041-6d86-4a39-b6c8-8a747e45821d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:22.911808 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-c4115041-6d86-4a39-b6c8-8a747e45821d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28152 microversion: 2.1 time: 0.089541 Oct 19 08:26:22.916065 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 232/469] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:22 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28152 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:26:22.939263 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-8116b657-e346-4379-8613-aa3ba2f82172 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:22.946409 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-8116b657-e346-4379-8613-aa3ba2f82172 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.144672 Oct 19 08:26:22.946988 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 238/470] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:22 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:26:23.779076 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-540d0b1b-32d9-415a-a1cb-a27635200174 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:23.779774 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-540d0b1b-32d9-415a-a1cb-a27635200174 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:23.786161 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-540d0b1b-32d9-415a-a1cb-a27635200174 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:23.786640 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-540d0b1b-32d9-415a-a1cb-a27635200174 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:23.787400 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-540d0b1b-32d9-415a-a1cb-a27635200174 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:23.787831 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-540d0b1b-32d9-415a-a1cb-a27635200174 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:23.829962 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-98432015-fbdd-466f-bc32-edf83fe1dbd9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:23.831321 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-98432015-fbdd-466f-bc32-edf83fe1dbd9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:23.838932 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-98432015-fbdd-466f-bc32-edf83fe1dbd9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:23.839376 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-98432015-fbdd-466f-bc32-edf83fe1dbd9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:23.840189 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-98432015-fbdd-466f-bc32-edf83fe1dbd9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:23.840615 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-98432015-fbdd-466f-bc32-edf83fe1dbd9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:23.915215 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-98432015-fbdd-466f-bc32-edf83fe1dbd9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28212 microversion: 2.20 time: 0.089750 Oct 19 08:26:23.915885 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 239/471] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:23 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28212 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:26:23.918009 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-540d0b1b-32d9-415a-a1cb-a27635200174 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:23.924666 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-0158c4a7-2881-4d82-82fd-8ff215153ffa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:23.925655 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-0158c4a7-2881-4d82-82fd-8ff215153ffa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:23.926287 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-540d0b1b-32d9-415a-a1cb-a27635200174 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1317 microversion: 2.1 time: 0.151181 Oct 19 08:26:23.926869 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 233/472] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:23 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:23.932151 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0158c4a7-2881-4d82-82fd-8ff215153ffa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:23.932596 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0158c4a7-2881-4d82-82fd-8ff215153ffa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:23.933476 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0158c4a7-2881-4d82-82fd-8ff215153ffa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:23.933913 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0158c4a7-2881-4d82-82fd-8ff215153ffa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:23.962886 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c54b5ad4-5c8f-462f-9af4-6b40d6d5a676 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:23.963478 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-c54b5ad4-5c8f-462f-9af4-6b40d6d5a676 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:23.969159 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c54b5ad4-5c8f-462f-9af4-6b40d6d5a676 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:23.969594 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c54b5ad4-5c8f-462f-9af4-6b40d6d5a676 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:23.970339 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c54b5ad4-5c8f-462f-9af4-6b40d6d5a676 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:23.970795 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c54b5ad4-5c8f-462f-9af4-6b40d6d5a676 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:24.020035 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-0158c4a7-2881-4d82-82fd-8ff215153ffa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28152 microversion: 2.1 time: 0.100243 Oct 19 08:26:24.023901 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 240/473] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:23 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28152 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:26:24.090912 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-c54b5ad4-5c8f-462f-9af4-6b40d6d5a676 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:24.107153 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-c54b5ad4-5c8f-462f-9af4-6b40d6d5a676 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.147660 Oct 19 08:26:24.107721 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 234/474] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:23 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:26:24.927818 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-03ff2109-1f12-4476-a810-343159d5557c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:24.928974 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-03ff2109-1f12-4476-a810-343159d5557c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:24.938162 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-03ff2109-1f12-4476-a810-343159d5557c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:24.938870 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-03ff2109-1f12-4476-a810-343159d5557c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:24.939891 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-03ff2109-1f12-4476-a810-343159d5557c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:24.940397 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-03ff2109-1f12-4476-a810-343159d5557c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:24.947137 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-ed996583-51a6-47ae-870b-ce5edbe6e2f6 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:24.948554 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-ed996583-51a6-47ae-870b-ce5edbe6e2f6 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:24.955171 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ed996583-51a6-47ae-870b-ce5edbe6e2f6 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:24.955710 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ed996583-51a6-47ae-870b-ce5edbe6e2f6 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:24.956646 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ed996583-51a6-47ae-870b-ce5edbe6e2f6 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:24.957132 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ed996583-51a6-47ae-870b-ce5edbe6e2f6 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:25.024470 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-03ff2109-1f12-4476-a810-343159d5557c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28212 microversion: 2.20 time: 0.100448 Oct 19 08:26:25.025651 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 241/475] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:24 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28212 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:25.035687 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-66f95959-ec39-47b4-9738-d6c3e40f3c7b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:25.036973 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-66f95959-ec39-47b4-9738-d6c3e40f3c7b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:25.042829 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-66f95959-ec39-47b4-9738-d6c3e40f3c7b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:25.043273 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-66f95959-ec39-47b4-9738-d6c3e40f3c7b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:25.044034 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-66f95959-ec39-47b4-9738-d6c3e40f3c7b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:25.044465 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-66f95959-ec39-47b4-9738-d6c3e40f3c7b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:25.106086 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-ed996583-51a6-47ae-870b-ce5edbe6e2f6 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:25.114313 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-ed996583-51a6-47ae-870b-ce5edbe6e2f6 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1317 microversion: 2.1 time: 0.174136 Oct 19 08:26:25.115108 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 235/476] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:24 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:26:25.115564 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-66f95959-ec39-47b4-9738-d6c3e40f3c7b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28152 microversion: 2.1 time: 0.083448 Oct 19 08:26:25.116561 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 242/477] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:25 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:26:25.128348 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-075b0eb6-edd0-42c5-bc63-8f936437d4b6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:25.128934 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-075b0eb6-edd0-42c5-bc63-8f936437d4b6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:25.134983 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-075b0eb6-edd0-42c5-bc63-8f936437d4b6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:25.135438 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-075b0eb6-edd0-42c5-bc63-8f936437d4b6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:25.136169 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-075b0eb6-edd0-42c5-bc63-8f936437d4b6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:25.136590 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-075b0eb6-edd0-42c5-bc63-8f936437d4b6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:25.315555 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-075b0eb6-edd0-42c5-bc63-8f936437d4b6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:25.323990 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-075b0eb6-edd0-42c5-bc63-8f936437d4b6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.199098 Oct 19 08:26:25.334463 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 236/478] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:25 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:26.037894 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b7f85c20-1e88-4356-909c-7286e1ccd68b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:26.038910 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b7f85c20-1e88-4356-909c-7286e1ccd68b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:26.045955 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b7f85c20-1e88-4356-909c-7286e1ccd68b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:26.046422 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b7f85c20-1e88-4356-909c-7286e1ccd68b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:26.047295 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b7f85c20-1e88-4356-909c-7286e1ccd68b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:26.047747 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b7f85c20-1e88-4356-909c-7286e1ccd68b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:26.128116 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-0c8a00be-f44f-4e95-b26e-6657645f3600 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:26.129463 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-0c8a00be-f44f-4e95-b26e-6657645f3600 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:26.132063 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b7f85c20-1e88-4356-909c-7286e1ccd68b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28212 microversion: 2.20 time: 0.098793 Oct 19 08:26:26.132940 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 243/479] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:26 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28212 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:26.135325 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0c8a00be-f44f-4e95-b26e-6657645f3600 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:26.135774 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0c8a00be-f44f-4e95-b26e-6657645f3600 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:26.136540 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0c8a00be-f44f-4e95-b26e-6657645f3600 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:26.136968 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0c8a00be-f44f-4e95-b26e-6657645f3600 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:26.137809 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c18174a8-ce2b-4cc3-8f49-923b866e1e99 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:26.138518 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c18174a8-ce2b-4cc3-8f49-923b866e1e99 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:26.145365 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c18174a8-ce2b-4cc3-8f49-923b866e1e99 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:26.145992 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c18174a8-ce2b-4cc3-8f49-923b866e1e99 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:26.146786 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c18174a8-ce2b-4cc3-8f49-923b866e1e99 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:26.147215 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c18174a8-ce2b-4cc3-8f49-923b866e1e99 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:26.240692 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-0c8a00be-f44f-4e95-b26e-6657645f3600 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28152 microversion: 2.1 time: 0.116565 Oct 19 08:26:26.241373 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 237/480] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:26 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28152 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:26:26.269833 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-c18174a8-ce2b-4cc3-8f49-923b866e1e99 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:26.276979 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c18174a8-ce2b-4cc3-8f49-923b866e1e99 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1317 microversion: 2.1 time: 0.143055 Oct 19 08:26:26.277531 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 244/481] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:26 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:26.341087 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8234d800-564e-4249-ba24-5929e6dafa8a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:26.341771 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-8234d800-564e-4249-ba24-5929e6dafa8a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:26.348692 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8234d800-564e-4249-ba24-5929e6dafa8a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:26.349134 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8234d800-564e-4249-ba24-5929e6dafa8a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:26.349887 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8234d800-564e-4249-ba24-5929e6dafa8a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:26.350315 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8234d800-564e-4249-ba24-5929e6dafa8a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:26.484830 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-8234d800-564e-4249-ba24-5929e6dafa8a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:26.492204 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-8234d800-564e-4249-ba24-5929e6dafa8a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.155155 Oct 19 08:26:26.492760 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 238/482] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:26 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:27.143573 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-5ca78d5b-c325-44d5-a96e-9e8d2abc571f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:27.144533 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-5ca78d5b-c325-44d5-a96e-9e8d2abc571f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:27.150761 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5ca78d5b-c325-44d5-a96e-9e8d2abc571f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:27.151204 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5ca78d5b-c325-44d5-a96e-9e8d2abc571f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:27.151963 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5ca78d5b-c325-44d5-a96e-9e8d2abc571f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:27.152395 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5ca78d5b-c325-44d5-a96e-9e8d2abc571f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:27.217655 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-5ca78d5b-c325-44d5-a96e-9e8d2abc571f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28212 microversion: 2.20 time: 0.077730 Oct 19 08:26:27.218272 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 245/483] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:27 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:26:27.252259 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-1f5dd957-1c50-4e89-87ae-fbb9730f5b5b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:27.253167 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-1f5dd957-1c50-4e89-87ae-fbb9730f5b5b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:27.259200 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1f5dd957-1c50-4e89-87ae-fbb9730f5b5b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:27.259642 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1f5dd957-1c50-4e89-87ae-fbb9730f5b5b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:27.260402 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1f5dd957-1c50-4e89-87ae-fbb9730f5b5b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:27.260831 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1f5dd957-1c50-4e89-87ae-fbb9730f5b5b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:27.294310 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-f5b59c76-031e-479f-a277-d7897319bfc0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:27.295019 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-f5b59c76-031e-479f-a277-d7897319bfc0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:27.302012 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f5b59c76-031e-479f-a277-d7897319bfc0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:27.302452 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f5b59c76-031e-479f-a277-d7897319bfc0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:27.303231 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f5b59c76-031e-479f-a277-d7897319bfc0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:27.303656 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f5b59c76-031e-479f-a277-d7897319bfc0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:27.337984 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-1f5dd957-1c50-4e89-87ae-fbb9730f5b5b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28152 microversion: 2.1 time: 0.089199 Oct 19 08:26:27.338643 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 239/484] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:27 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28152 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:26:27.427497 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-f5b59c76-031e-479f-a277-d7897319bfc0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:27.434540 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-f5b59c76-031e-479f-a277-d7897319bfc0 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1317 microversion: 2.1 time: 0.144084 Oct 19 08:26:27.435098 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 246/485] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:27 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1317 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:26:27.510073 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-5d265e6a-e619-456a-86a8-e9e3e44ab2cb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:27.510800 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-5d265e6a-e619-456a-86a8-e9e3e44ab2cb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:27.518596 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5d265e6a-e619-456a-86a8-e9e3e44ab2cb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:27.519047 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5d265e6a-e619-456a-86a8-e9e3e44ab2cb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:27.519874 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5d265e6a-e619-456a-86a8-e9e3e44ab2cb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:27.520311 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5d265e6a-e619-456a-86a8-e9e3e44ab2cb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:27.647740 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-5d265e6a-e619-456a-86a8-e9e3e44ab2cb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:27.654877 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-5d265e6a-e619-456a-86a8-e9e3e44ab2cb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.149200 Oct 19 08:26:27.655425 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 240/486] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:27 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:28.229737 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e8853c5c-eb7a-4966-9448-d37278348a49 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:28.230674 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e8853c5c-eb7a-4966-9448-d37278348a49 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:28.236592 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e8853c5c-eb7a-4966-9448-d37278348a49 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:28.237043 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e8853c5c-eb7a-4966-9448-d37278348a49 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:28.237800 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e8853c5c-eb7a-4966-9448-d37278348a49 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:28.238229 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e8853c5c-eb7a-4966-9448-d37278348a49 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:28.307229 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e8853c5c-eb7a-4966-9448-d37278348a49 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28212 microversion: 2.20 time: 0.081067 Oct 19 08:26:28.307827 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 247/487] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:28 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28212 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:28.348976 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-a71e0ee9-b515-42c7-a29d-81743836fdae tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:28.349889 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-a71e0ee9-b515-42c7-a29d-81743836fdae tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:28.355760 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a71e0ee9-b515-42c7-a29d-81743836fdae tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:28.356206 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a71e0ee9-b515-42c7-a29d-81743836fdae tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:28.356962 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a71e0ee9-b515-42c7-a29d-81743836fdae tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:28.357390 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a71e0ee9-b515-42c7-a29d-81743836fdae tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:28.448818 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-a71e0ee9-b515-42c7-a29d-81743836fdae tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28152 microversion: 2.1 time: 0.103184 Oct 19 08:26:28.450806 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 241/488] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:28 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28152 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:26:28.452556 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3a8aac30-4acf-48a0-8bbe-e627607f7ff6 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:28.453604 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3a8aac30-4acf-48a0-8bbe-e627607f7ff6 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:28.462276 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3a8aac30-4acf-48a0-8bbe-e627607f7ff6 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:28.462931 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3a8aac30-4acf-48a0-8bbe-e627607f7ff6 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:28.464148 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3a8aac30-4acf-48a0-8bbe-e627607f7ff6 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:28.464584 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3a8aac30-4acf-48a0-8bbe-e627607f7ff6 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:28.590366 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3a8aac30-4acf-48a0-8bbe-e627607f7ff6 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:28.597671 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3a8aac30-4acf-48a0-8bbe-e627607f7ff6 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1317 microversion: 2.1 time: 0.149851 Oct 19 08:26:28.598223 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 248/489] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:28 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:26:28.672973 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-94b99bb5-0b09-4cff-a9d3-f7eaa706c5c3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:28.673653 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-94b99bb5-0b09-4cff-a9d3-f7eaa706c5c3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:28.679970 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-94b99bb5-0b09-4cff-a9d3-f7eaa706c5c3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:28.680413 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-94b99bb5-0b09-4cff-a9d3-f7eaa706c5c3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:28.681169 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-94b99bb5-0b09-4cff-a9d3-f7eaa706c5c3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:28.681595 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-94b99bb5-0b09-4cff-a9d3-f7eaa706c5c3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:28.801369 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-94b99bb5-0b09-4cff-a9d3-f7eaa706c5c3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:28.808520 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-94b99bb5-0b09-4cff-a9d3-f7eaa706c5c3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.140004 Oct 19 08:26:28.809218 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 242/490] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:28 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:29.318954 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c99740e6-dbe6-446a-af0c-8d6028d837b7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:29.319865 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c99740e6-dbe6-446a-af0c-8d6028d837b7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:29.325785 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c99740e6-dbe6-446a-af0c-8d6028d837b7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:29.326224 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c99740e6-dbe6-446a-af0c-8d6028d837b7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:29.327058 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c99740e6-dbe6-446a-af0c-8d6028d837b7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:29.327478 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c99740e6-dbe6-446a-af0c-8d6028d837b7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:29.397360 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c99740e6-dbe6-446a-af0c-8d6028d837b7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28212 microversion: 2.20 time: 0.081645 Oct 19 08:26:29.398394 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 249/491] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:29 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28212 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:29.465384 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2d77e272-c734-4326-aefe-401d5a821bac tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:29.466370 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2d77e272-c734-4326-aefe-401d5a821bac tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:29.473981 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2d77e272-c734-4326-aefe-401d5a821bac tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:29.474576 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2d77e272-c734-4326-aefe-401d5a821bac tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:29.475497 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2d77e272-c734-4326-aefe-401d5a821bac tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:29.475935 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2d77e272-c734-4326-aefe-401d5a821bac tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:29.549250 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2d77e272-c734-4326-aefe-401d5a821bac tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28152 microversion: 2.1 time: 0.087940 Oct 19 08:26:29.549884 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 243/492] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:29 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28152 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:26:29.614734 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-244ca755-6ef5-4b36-b9e3-84f92ef817a8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:29.615444 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-244ca755-6ef5-4b36-b9e3-84f92ef817a8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:29.621697 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-244ca755-6ef5-4b36-b9e3-84f92ef817a8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:29.622136 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-244ca755-6ef5-4b36-b9e3-84f92ef817a8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:29.622918 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-244ca755-6ef5-4b36-b9e3-84f92ef817a8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:29.623338 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-244ca755-6ef5-4b36-b9e3-84f92ef817a8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:29.743128 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-244ca755-6ef5-4b36-b9e3-84f92ef817a8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:29.751457 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-244ca755-6ef5-4b36-b9e3-84f92ef817a8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1317 microversion: 2.1 time: 0.140419 Oct 19 08:26:29.752479 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 250/493] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:29 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1317 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:29.825367 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-b6be2fec-fdb0-4a2b-bbcc-8f898a14cf70 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:29.825977 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-b6be2fec-fdb0-4a2b-bbcc-8f898a14cf70 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:29.833005 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b6be2fec-fdb0-4a2b-bbcc-8f898a14cf70 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:29.833443 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b6be2fec-fdb0-4a2b-bbcc-8f898a14cf70 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:29.834216 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b6be2fec-fdb0-4a2b-bbcc-8f898a14cf70 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:29.834666 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b6be2fec-fdb0-4a2b-bbcc-8f898a14cf70 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:30.162161 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-b6be2fec-fdb0-4a2b-bbcc-8f898a14cf70 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:30.169339 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-b6be2fec-fdb0-4a2b-bbcc-8f898a14cf70 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.348040 Oct 19 08:26:30.169895 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 244/494] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:29 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:30.409943 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-7d85155f-43af-4001-aa3d-8e560f9d705a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:30.410893 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-7d85155f-43af-4001-aa3d-8e560f9d705a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:30.416829 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7d85155f-43af-4001-aa3d-8e560f9d705a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:30.417270 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7d85155f-43af-4001-aa3d-8e560f9d705a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:30.418035 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7d85155f-43af-4001-aa3d-8e560f9d705a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:30.418464 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7d85155f-43af-4001-aa3d-8e560f9d705a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:30.499065 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-7d85155f-43af-4001-aa3d-8e560f9d705a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28502 microversion: 2.20 time: 0.093363 Oct 19 08:26:30.499672 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 251/495] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:30 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28502 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:30.560801 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-1db31758-5a48-4720-b57c-a29131247104 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:30.561710 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-1db31758-5a48-4720-b57c-a29131247104 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:30.568019 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1db31758-5a48-4720-b57c-a29131247104 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:30.568456 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1db31758-5a48-4720-b57c-a29131247104 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:30.569209 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1db31758-5a48-4720-b57c-a29131247104 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:30.569859 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1db31758-5a48-4720-b57c-a29131247104 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:30.652402 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-1db31758-5a48-4720-b57c-a29131247104 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28152 microversion: 2.1 time: 0.095086 Oct 19 08:26:30.653077 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 245/496] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:30 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28152 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:26:30.769428 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3ce25e0c-46a3-4551-8c91-34337cf2a76a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:30.770113 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3ce25e0c-46a3-4551-8c91-34337cf2a76a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:30.776541 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3ce25e0c-46a3-4551-8c91-34337cf2a76a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:30.776989 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3ce25e0c-46a3-4551-8c91-34337cf2a76a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:30.777751 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3ce25e0c-46a3-4551-8c91-34337cf2a76a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:30.778180 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3ce25e0c-46a3-4551-8c91-34337cf2a76a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:30.899617 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3ce25e0c-46a3-4551-8c91-34337cf2a76a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:30.906948 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3ce25e0c-46a3-4551-8c91-34337cf2a76a tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1317 microversion: 2.1 time: 0.142024 Oct 19 08:26:30.908321 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 252/497] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:30 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:31.220755 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-1b35e46f-2dcb-4e92-a494-340ef255da7d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:31.221444 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-1b35e46f-2dcb-4e92-a494-340ef255da7d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:31.227900 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1b35e46f-2dcb-4e92-a494-340ef255da7d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:31.228346 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1b35e46f-2dcb-4e92-a494-340ef255da7d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:31.229105 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1b35e46f-2dcb-4e92-a494-340ef255da7d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:31.229535 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1b35e46f-2dcb-4e92-a494-340ef255da7d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:31.350566 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-1b35e46f-2dcb-4e92-a494-340ef255da7d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:31.357675 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-1b35e46f-2dcb-4e92-a494-340ef255da7d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.141000 Oct 19 08:26:31.358215 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 246/498] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:31 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:31.510943 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c711785f-bff6-4b63-9d22-4ede00ec4f4a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:31.511784 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c711785f-bff6-4b63-9d22-4ede00ec4f4a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:31.517602 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c711785f-bff6-4b63-9d22-4ede00ec4f4a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:31.518049 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c711785f-bff6-4b63-9d22-4ede00ec4f4a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:31.518832 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c711785f-bff6-4b63-9d22-4ede00ec4f4a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:31.519265 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c711785f-bff6-4b63-9d22-4ede00ec4f4a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:31.589959 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c711785f-bff6-4b63-9d22-4ede00ec4f4a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28502 microversion: 2.20 time: 0.082591 Oct 19 08:26:31.590641 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 253/499] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:31 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28502 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:31.663968 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-6b66e953-d3f6-46d9-8d40-7752ccea0321 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:31.664907 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-6b66e953-d3f6-46d9-8d40-7752ccea0321 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:31.670683 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b66e953-d3f6-46d9-8d40-7752ccea0321 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:31.671127 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b66e953-d3f6-46d9-8d40-7752ccea0321 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:31.671883 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b66e953-d3f6-46d9-8d40-7752ccea0321 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:31.672307 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b66e953-d3f6-46d9-8d40-7752ccea0321 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:31.771942 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-6b66e953-d3f6-46d9-8d40-7752ccea0321 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28443 microversion: 2.1 time: 0.111318 Oct 19 08:26:31.773422 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 247/500] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:31 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28443 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:26:31.926622 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b636116a-91bf-48c8-8ada-855fc1d93df8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:31.927389 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b636116a-91bf-48c8-8ada-855fc1d93df8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:31.934205 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b636116a-91bf-48c8-8ada-855fc1d93df8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:31.934679 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b636116a-91bf-48c8-8ada-855fc1d93df8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:31.935455 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b636116a-91bf-48c8-8ada-855fc1d93df8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:31.935885 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b636116a-91bf-48c8-8ada-855fc1d93df8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:32.058825 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-b636116a-91bf-48c8-8ada-855fc1d93df8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:32.066030 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b636116a-91bf-48c8-8ada-855fc1d93df8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1317 microversion: 2.1 time: 0.144643 Oct 19 08:26:32.066604 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 254/501] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:31 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:32.375125 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-553ac4e5-5f23-40d9-8f4a-c8afedd0fabc tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:32.375811 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-553ac4e5-5f23-40d9-8f4a-c8afedd0fabc tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:32.383414 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-553ac4e5-5f23-40d9-8f4a-c8afedd0fabc tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:32.383852 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-553ac4e5-5f23-40d9-8f4a-c8afedd0fabc tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:32.384617 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-553ac4e5-5f23-40d9-8f4a-c8afedd0fabc tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:32.385035 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-553ac4e5-5f23-40d9-8f4a-c8afedd0fabc tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:32.506543 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-553ac4e5-5f23-40d9-8f4a-c8afedd0fabc tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:32.514317 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-553ac4e5-5f23-40d9-8f4a-c8afedd0fabc tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.143078 Oct 19 08:26:32.514890 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 248/502] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:32 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:32.601261 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-29d06c0f-9340-4f77-bb4f-39a518180d34 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:32.602171 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-29d06c0f-9340-4f77-bb4f-39a518180d34 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:32.608618 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-29d06c0f-9340-4f77-bb4f-39a518180d34 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:32.609070 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-29d06c0f-9340-4f77-bb4f-39a518180d34 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:32.609847 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-29d06c0f-9340-4f77-bb4f-39a518180d34 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:32.610290 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-29d06c0f-9340-4f77-bb4f-39a518180d34 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:32.674753 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-29d06c0f-9340-4f77-bb4f-39a518180d34 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28502 microversion: 2.20 time: 0.076881 Oct 19 08:26:32.675272 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 255/503] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:32 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28502 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:32.783846 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-feaa15d8-d2ae-4b95-8ab0-a0cbfa4d3051 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:32.784781 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-feaa15d8-d2ae-4b95-8ab0-a0cbfa4d3051 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:32.790625 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-feaa15d8-d2ae-4b95-8ab0-a0cbfa4d3051 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:32.791070 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-feaa15d8-d2ae-4b95-8ab0-a0cbfa4d3051 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:32.791827 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-feaa15d8-d2ae-4b95-8ab0-a0cbfa4d3051 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:32.792253 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-feaa15d8-d2ae-4b95-8ab0-a0cbfa4d3051 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:32.871230 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-feaa15d8-d2ae-4b95-8ab0-a0cbfa4d3051 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28443 microversion: 2.1 time: 0.090975 Oct 19 08:26:32.871863 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 249/504] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:32 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:26:33.084086 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a1f3f183-1b69-4e6d-bed3-c7f3072e5020 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:33.084766 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a1f3f183-1b69-4e6d-bed3-c7f3072e5020 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:33.091166 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a1f3f183-1b69-4e6d-bed3-c7f3072e5020 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:33.091604 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a1f3f183-1b69-4e6d-bed3-c7f3072e5020 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:33.092368 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a1f3f183-1b69-4e6d-bed3-c7f3072e5020 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:33.092775 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a1f3f183-1b69-4e6d-bed3-c7f3072e5020 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:33.214437 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a1f3f183-1b69-4e6d-bed3-c7f3072e5020 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:33.221969 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a1f3f183-1b69-4e6d-bed3-c7f3072e5020 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1317 microversion: 2.1 time: 0.141829 Oct 19 08:26:33.222541 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 256/505] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:33 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1317 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:33.532754 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-f4d0194f-e8da-4078-885b-d5f9c089e109 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:33.533436 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-f4d0194f-e8da-4078-885b-d5f9c089e109 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:33.539779 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f4d0194f-e8da-4078-885b-d5f9c089e109 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:33.540216 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f4d0194f-e8da-4078-885b-d5f9c089e109 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:33.540960 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f4d0194f-e8da-4078-885b-d5f9c089e109 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:33.541379 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f4d0194f-e8da-4078-885b-d5f9c089e109 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:33.667204 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-f4d0194f-e8da-4078-885b-d5f9c089e109 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:33.674328 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-f4d0194f-e8da-4078-885b-d5f9c089e109 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.146083 Oct 19 08:26:33.674913 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 250/506] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:33 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:33.685557 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-6bde4f82-5df3-4451-b5cb-c0c09e79093a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:33.686506 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-6bde4f82-5df3-4451-b5cb-c0c09e79093a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:33.692859 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6bde4f82-5df3-4451-b5cb-c0c09e79093a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:33.693290 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6bde4f82-5df3-4451-b5cb-c0c09e79093a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:33.694034 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6bde4f82-5df3-4451-b5cb-c0c09e79093a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:33.694454 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6bde4f82-5df3-4451-b5cb-c0c09e79093a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:33.783832 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-6bde4f82-5df3-4451-b5cb-c0c09e79093a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.101720 Oct 19 08:26:33.784454 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 257/507] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:33 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:33.882786 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-ebb4e500-dbb6-4e2c-a097-ab3a5bac56b6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:33.883696 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-ebb4e500-dbb6-4e2c-a097-ab3a5bac56b6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:33.889339 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ebb4e500-dbb6-4e2c-a097-ab3a5bac56b6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:33.889814 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ebb4e500-dbb6-4e2c-a097-ab3a5bac56b6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:33.890768 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ebb4e500-dbb6-4e2c-a097-ab3a5bac56b6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:33.891077 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ebb4e500-dbb6-4e2c-a097-ab3a5bac56b6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:33.971648 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-ebb4e500-dbb6-4e2c-a097-ab3a5bac56b6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28443 microversion: 2.1 time: 0.092530 Oct 19 08:26:33.972195 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 251/508] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:33 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:26:34.239174 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e680d33b-656e-460f-9a03-3f8a20b539e8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:34.239766 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e680d33b-656e-460f-9a03-3f8a20b539e8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:34.245962 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e680d33b-656e-460f-9a03-3f8a20b539e8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:34.246397 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e680d33b-656e-460f-9a03-3f8a20b539e8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:34.247179 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e680d33b-656e-460f-9a03-3f8a20b539e8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:34.247594 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e680d33b-656e-460f-9a03-3f8a20b539e8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:34.367405 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-e680d33b-656e-460f-9a03-3f8a20b539e8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:34.374721 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e680d33b-656e-460f-9a03-3f8a20b539e8 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1317 microversion: 2.1 time: 0.139779 Oct 19 08:26:34.375271 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 258/509] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:34 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1317 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:34.691575 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-07c06bdf-375a-4bcf-83d9-a31c22e59b0b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:34.692323 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-07c06bdf-375a-4bcf-83d9-a31c22e59b0b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:34.699014 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-07c06bdf-375a-4bcf-83d9-a31c22e59b0b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:34.699453 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-07c06bdf-375a-4bcf-83d9-a31c22e59b0b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:34.700216 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-07c06bdf-375a-4bcf-83d9-a31c22e59b0b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:34.700644 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-07c06bdf-375a-4bcf-83d9-a31c22e59b0b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:34.796623 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-0dfd1203-19b8-461d-a64f-42b440fb60bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:34.799447 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-0dfd1203-19b8-461d-a64f-42b440fb60bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:34.806248 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0dfd1203-19b8-461d-a64f-42b440fb60bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:34.806952 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0dfd1203-19b8-461d-a64f-42b440fb60bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:34.808121 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0dfd1203-19b8-461d-a64f-42b440fb60bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:34.808911 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0dfd1203-19b8-461d-a64f-42b440fb60bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:34.837030 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-07c06bdf-375a-4bcf-83d9-a31c22e59b0b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:34.846075 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-07c06bdf-375a-4bcf-83d9-a31c22e59b0b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.158629 Oct 19 08:26:34.846760 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 252/510] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:34 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:34.882299 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-0dfd1203-19b8-461d-a64f-42b440fb60bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.089794 Oct 19 08:26:34.884179 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 259/511] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:34 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:26:34.982894 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-5a08db5b-ba12-46a3-8f75-f4415190aea4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:34.983831 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-5a08db5b-ba12-46a3-8f75-f4415190aea4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:34.990415 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5a08db5b-ba12-46a3-8f75-f4415190aea4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:34.990911 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5a08db5b-ba12-46a3-8f75-f4415190aea4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:34.991704 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5a08db5b-ba12-46a3-8f75-f4415190aea4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:34.992133 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5a08db5b-ba12-46a3-8f75-f4415190aea4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:35.093939 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-5a08db5b-ba12-46a3-8f75-f4415190aea4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.114521 Oct 19 08:26:35.096214 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 253/512] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:34 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:26:35.393015 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-7abb2359-1118-40d3-b83d-58457fd7a800 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:35.393624 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-7abb2359-1118-40d3-b83d-58457fd7a800 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:35.400229 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7abb2359-1118-40d3-b83d-58457fd7a800 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:35.400668 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7abb2359-1118-40d3-b83d-58457fd7a800 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:35.401432 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7abb2359-1118-40d3-b83d-58457fd7a800 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:35.401855 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7abb2359-1118-40d3-b83d-58457fd7a800 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:35.524749 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-7abb2359-1118-40d3-b83d-58457fd7a800 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:35.531878 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-7abb2359-1118-40d3-b83d-58457fd7a800 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1317 microversion: 2.1 time: 0.142901 Oct 19 08:26:35.532951 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 260/513] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:35 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1317 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:35.863672 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-cc7d78bf-3557-46b4-ac57-ccefb1153c5f tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:35.864359 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-cc7d78bf-3557-46b4-ac57-ccefb1153c5f tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:35.871542 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cc7d78bf-3557-46b4-ac57-ccefb1153c5f tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:35.871984 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cc7d78bf-3557-46b4-ac57-ccefb1153c5f tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:35.872775 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cc7d78bf-3557-46b4-ac57-ccefb1153c5f tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:35.873203 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cc7d78bf-3557-46b4-ac57-ccefb1153c5f tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:35.894867 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-868f1455-efe0-4630-be85-8a41b978e6f3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:35.895777 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-868f1455-efe0-4630-be85-8a41b978e6f3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:35.901375 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-868f1455-efe0-4630-be85-8a41b978e6f3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:35.901812 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-868f1455-efe0-4630-be85-8a41b978e6f3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:35.902582 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-868f1455-efe0-4630-be85-8a41b978e6f3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:35.903011 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-868f1455-efe0-4630-be85-8a41b978e6f3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:36.005153 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-cc7d78bf-3557-46b4-ac57-ccefb1153c5f tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:36.011418 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-868f1455-efe0-4630-be85-8a41b978e6f3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.120558 Oct 19 08:26:36.012339 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 261/514] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:35 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:26:36.012707 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-cc7d78bf-3557-46b4-ac57-ccefb1153c5f tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.153175 Oct 19 08:26:36.013333 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 254/515] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:35 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:36.105737 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-322a7575-1ffb-40d3-9d76-451126b97d8e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:36.106688 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-322a7575-1ffb-40d3-9d76-451126b97d8e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:36.113615 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-322a7575-1ffb-40d3-9d76-451126b97d8e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:36.114055 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-322a7575-1ffb-40d3-9d76-451126b97d8e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:36.114849 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-322a7575-1ffb-40d3-9d76-451126b97d8e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:36.115281 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-322a7575-1ffb-40d3-9d76-451126b97d8e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:36.185505 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-322a7575-1ffb-40d3-9d76-451126b97d8e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.083745 Oct 19 08:26:36.186098 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 262/516] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:36 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:26:36.549850 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-f7ab6dac-44f0-48b4-9bf2-64cdcf906816 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:36.550438 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-f7ab6dac-44f0-48b4-9bf2-64cdcf906816 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:36.556210 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f7ab6dac-44f0-48b4-9bf2-64cdcf906816 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:36.556652 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f7ab6dac-44f0-48b4-9bf2-64cdcf906816 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:36.557395 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f7ab6dac-44f0-48b4-9bf2-64cdcf906816 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:36.557813 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f7ab6dac-44f0-48b4-9bf2-64cdcf906816 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:36.677013 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-f7ab6dac-44f0-48b4-9bf2-64cdcf906816 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:36.684298 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-f7ab6dac-44f0-48b4-9bf2-64cdcf906816 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1317 microversion: 2.1 time: 0.138988 Oct 19 08:26:36.684850 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 255/517] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:36 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1317 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:37.023762 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-29c91f27-af3e-477c-a706-0ae4e6ceaae6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:37.024784 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-29c91f27-af3e-477c-a706-0ae4e6ceaae6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:37.030032 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-b680be4e-3809-43a0-9794-404909bdc5ec tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:37.030667 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-b680be4e-3809-43a0-9794-404909bdc5ec tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:37.031535 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-29c91f27-af3e-477c-a706-0ae4e6ceaae6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:37.031980 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-29c91f27-af3e-477c-a706-0ae4e6ceaae6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:37.032750 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-29c91f27-af3e-477c-a706-0ae4e6ceaae6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:37.033175 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-29c91f27-af3e-477c-a706-0ae4e6ceaae6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:37.037157 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b680be4e-3809-43a0-9794-404909bdc5ec tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:37.037594 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b680be4e-3809-43a0-9794-404909bdc5ec tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:37.038355 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b680be4e-3809-43a0-9794-404909bdc5ec tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:37.038810 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b680be4e-3809-43a0-9794-404909bdc5ec tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:37.156743 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-29c91f27-af3e-477c-a706-0ae4e6ceaae6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.136731 Oct 19 08:26:37.158477 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 263/518] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:37 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:37.164291 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-b680be4e-3809-43a0-9794-404909bdc5ec tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:37.171489 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-b680be4e-3809-43a0-9794-404909bdc5ec tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.145248 Oct 19 08:26:37.172038 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 256/519] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:37 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:26:37.197383 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ba137dcc-44c2-472c-baf0-b78661489ea9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:37.198511 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ba137dcc-44c2-472c-baf0-b78661489ea9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:37.205422 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ba137dcc-44c2-472c-baf0-b78661489ea9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:37.205856 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ba137dcc-44c2-472c-baf0-b78661489ea9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:37.206637 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ba137dcc-44c2-472c-baf0-b78661489ea9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:37.207064 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ba137dcc-44c2-472c-baf0-b78661489ea9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:37.356874 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ba137dcc-44c2-472c-baf0-b78661489ea9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.163194 Oct 19 08:26:37.357722 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 264/520] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:37 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:26:37.700897 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d3a99fa0-41cc-4764-9a73-68a65aace2ed tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:37.701494 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-d3a99fa0-41cc-4764-9a73-68a65aace2ed tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:37.707457 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d3a99fa0-41cc-4764-9a73-68a65aace2ed tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:37.707896 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d3a99fa0-41cc-4764-9a73-68a65aace2ed tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:37.708643 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d3a99fa0-41cc-4764-9a73-68a65aace2ed tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:37.709066 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d3a99fa0-41cc-4764-9a73-68a65aace2ed tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:37.828918 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-d3a99fa0-41cc-4764-9a73-68a65aace2ed tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:37.836432 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-d3a99fa0-41cc-4764-9a73-68a65aace2ed tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1317 microversion: 2.1 time: 0.139209 Oct 19 08:26:37.836983 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 257/521] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:37 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1317 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:38.168564 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-28712968-4499-4fe9-bc8e-c27c8c19b7af tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:38.169559 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-28712968-4499-4fe9-bc8e-c27c8c19b7af tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:38.175895 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-28712968-4499-4fe9-bc8e-c27c8c19b7af tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:38.176333 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-28712968-4499-4fe9-bc8e-c27c8c19b7af tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:38.177087 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-28712968-4499-4fe9-bc8e-c27c8c19b7af tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:38.177511 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-28712968-4499-4fe9-bc8e-c27c8c19b7af tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:38.187938 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-ae07069f-6e0f-4b2a-bf45-9eae825cf3a4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:38.188888 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-ae07069f-6e0f-4b2a-bf45-9eae825cf3a4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:38.194504 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ae07069f-6e0f-4b2a-bf45-9eae825cf3a4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:38.194966 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ae07069f-6e0f-4b2a-bf45-9eae825cf3a4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:38.195717 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ae07069f-6e0f-4b2a-bf45-9eae825cf3a4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:38.196137 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ae07069f-6e0f-4b2a-bf45-9eae825cf3a4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:38.320292 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-ae07069f-6e0f-4b2a-bf45-9eae825cf3a4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:38.327443 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-ae07069f-6e0f-4b2a-bf45-9eae825cf3a4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.143056 Oct 19 08:26:38.328007 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 258/522] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:38 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:26:38.360787 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-28712968-4499-4fe9-bc8e-c27c8c19b7af tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.195920 Oct 19 08:26:38.361412 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 265/523] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:38 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:38.369408 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-117a8907-cc28-4e96-a84d-fadb43b5c99f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:38.370425 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-117a8907-cc28-4e96-a84d-fadb43b5c99f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:38.377094 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-117a8907-cc28-4e96-a84d-fadb43b5c99f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:38.377539 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-117a8907-cc28-4e96-a84d-fadb43b5c99f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:38.378321 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-117a8907-cc28-4e96-a84d-fadb43b5c99f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:38.378782 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-117a8907-cc28-4e96-a84d-fadb43b5c99f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:38.451273 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-117a8907-cc28-4e96-a84d-fadb43b5c99f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.085860 Oct 19 08:26:38.455148 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 259/524] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:38 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:26:38.853751 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c50697a2-e6f0-4de7-9a1f-445a865c23cf tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:38.854357 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c50697a2-e6f0-4de7-9a1f-445a865c23cf tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:38.860740 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c50697a2-e6f0-4de7-9a1f-445a865c23cf tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:38.861174 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c50697a2-e6f0-4de7-9a1f-445a865c23cf tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:38.861924 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c50697a2-e6f0-4de7-9a1f-445a865c23cf tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:38.862344 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c50697a2-e6f0-4de7-9a1f-445a865c23cf tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:38.982972 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-c50697a2-e6f0-4de7-9a1f-445a865c23cf tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:38.991159 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c50697a2-e6f0-4de7-9a1f-445a865c23cf tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1317 microversion: 2.1 time: 0.141349 Oct 19 08:26:38.991723 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 266/525] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:38 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1317 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:39.345065 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-0bdebd02-a06d-4a43-ad78-d7e2f61cd91c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:39.345749 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-0bdebd02-a06d-4a43-ad78-d7e2f61cd91c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:39.352343 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0bdebd02-a06d-4a43-ad78-d7e2f61cd91c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:39.352786 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0bdebd02-a06d-4a43-ad78-d7e2f61cd91c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:39.353537 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0bdebd02-a06d-4a43-ad78-d7e2f61cd91c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:39.353963 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0bdebd02-a06d-4a43-ad78-d7e2f61cd91c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:39.372230 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a917071c-f516-4c1d-a459-1ec07e927a3f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:39.373243 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a917071c-f516-4c1d-a459-1ec07e927a3f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:39.379092 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a917071c-f516-4c1d-a459-1ec07e927a3f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:39.381029 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a917071c-f516-4c1d-a459-1ec07e927a3f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:39.381867 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a917071c-f516-4c1d-a459-1ec07e927a3f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:39.382359 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a917071c-f516-4c1d-a459-1ec07e927a3f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:39.475451 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-0bdebd02-a06d-4a43-ad78-d7e2f61cd91c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:39.482670 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-0bdebd02-a06d-4a43-ad78-d7e2f61cd91c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1522 microversion: 2.1 time: 0.141453 Oct 19 08:26:39.483235 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 260/526] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:39 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1522 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:39.487504 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-364ea0fa-f15d-4e4c-85a6-0a9b3aafae9a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:39.488390 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-364ea0fa-f15d-4e4c-85a6-0a9b3aafae9a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:39.494166 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-364ea0fa-f15d-4e4c-85a6-0a9b3aafae9a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:39.494653 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-364ea0fa-f15d-4e4c-85a6-0a9b3aafae9a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:39.495406 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-364ea0fa-f15d-4e4c-85a6-0a9b3aafae9a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:39.495828 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-364ea0fa-f15d-4e4c-85a6-0a9b3aafae9a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:39.619801 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a917071c-f516-4c1d-a459-1ec07e927a3f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.251112 Oct 19 08:26:39.620446 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 267/527] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:39 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:26:39.659350 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-364ea0fa-f15d-4e4c-85a6-0a9b3aafae9a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.174831 Oct 19 08:26:39.659910 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 261/528] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:39 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:26:40.008871 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b6b52b4d-21e6-4b81-9bb2-86535930496e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:40.009568 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b6b52b4d-21e6-4b81-9bb2-86535930496e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:40.016077 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b6b52b4d-21e6-4b81-9bb2-86535930496e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:40.016494 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b6b52b4d-21e6-4b81-9bb2-86535930496e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:40.017251 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b6b52b4d-21e6-4b81-9bb2-86535930496e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:40.017741 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b6b52b4d-21e6-4b81-9bb2-86535930496e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:40.146072 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-b6b52b4d-21e6-4b81-9bb2-86535930496e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:40.156763 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b6b52b4d-21e6-4b81-9bb2-86535930496e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1317 microversion: 2.1 time: 0.152215 Oct 19 08:26:40.157349 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 268/529] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:40 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:40.500479 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-25094bd7-5b4f-4a20-9752-46fd7f05d13a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:40.501072 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-25094bd7-5b4f-4a20-9752-46fd7f05d13a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:40.507873 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-25094bd7-5b4f-4a20-9752-46fd7f05d13a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:40.508309 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-25094bd7-5b4f-4a20-9752-46fd7f05d13a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:40.509052 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-25094bd7-5b4f-4a20-9752-46fd7f05d13a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:40.509476 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-25094bd7-5b4f-4a20-9752-46fd7f05d13a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:40.629736 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-25094bd7-5b4f-4a20-9752-46fd7f05d13a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:40.632159 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-6420e77f-08dc-4263-a15d-514344bccc64 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:40.633218 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-6420e77f-08dc-4263-a15d-514344bccc64 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:40.638373 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-25094bd7-5b4f-4a20-9752-46fd7f05d13a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1502 microversion: 2.1 time: 0.141440 Oct 19 08:26:40.639695 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6420e77f-08dc-4263-a15d-514344bccc64 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:40.640128 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6420e77f-08dc-4263-a15d-514344bccc64 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:40.640890 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6420e77f-08dc-4263-a15d-514344bccc64 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:40.641340 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6420e77f-08dc-4263-a15d-514344bccc64 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:40.643678 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 262/530] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:40 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1502 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:40.654606 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-32ed7736-c960-494c-9042-d26705088c56 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:40.655211 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-32ed7736-c960-494c-9042-d26705088c56 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:40.660875 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-32ed7736-c960-494c-9042-d26705088c56 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:40.661314 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-32ed7736-c960-494c-9042-d26705088c56 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:40.662720 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-32ed7736-c960-494c-9042-d26705088c56 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:40.663149 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-32ed7736-c960-494c-9042-d26705088c56 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:40.735228 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-6420e77f-08dc-4263-a15d-514344bccc64 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.107327 Oct 19 08:26:40.735874 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 269/531] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:40 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:26:40.742279 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-0c27f6c6-e7da-4063-94c5-965eeacde9d6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:40.743710 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-0c27f6c6-e7da-4063-94c5-965eeacde9d6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:40.750634 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0c27f6c6-e7da-4063-94c5-965eeacde9d6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:40.751378 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0c27f6c6-e7da-4063-94c5-965eeacde9d6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:40.752331 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0c27f6c6-e7da-4063-94c5-965eeacde9d6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:40.752775 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0c27f6c6-e7da-4063-94c5-965eeacde9d6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:40.786244 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-32ed7736-c960-494c-9042-d26705088c56 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:40.794396 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-32ed7736-c960-494c-9042-d26705088c56 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1515 microversion: 2.1 time: 0.143318 Oct 19 08:26:40.794985 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 263/532] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:40 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1515 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:26:40.834739 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-0c27f6c6-e7da-4063-94c5-965eeacde9d6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.096222 Oct 19 08:26:40.835542 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 270/533] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:40 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:26:41.172859 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-3eb9fffe-1e52-4b2e-ae81-e6d31d07c658 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:41.173461 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-3eb9fffe-1e52-4b2e-ae81-e6d31d07c658 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:41.179249 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3eb9fffe-1e52-4b2e-ae81-e6d31d07c658 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:41.179691 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3eb9fffe-1e52-4b2e-ae81-e6d31d07c658 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:41.180494 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3eb9fffe-1e52-4b2e-ae81-e6d31d07c658 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:41.180918 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3eb9fffe-1e52-4b2e-ae81-e6d31d07c658 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:41.309071 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-3eb9fffe-1e52-4b2e-ae81-e6d31d07c658 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:41.316701 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-3eb9fffe-1e52-4b2e-ae81-e6d31d07c658 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1317 microversion: 2.1 time: 0.147376 Oct 19 08:26:41.317236 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 264/534] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:41 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:41.747494 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c7baeed3-7618-459b-b28a-a9f3b5c901ae tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:41.748483 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c7baeed3-7618-459b-b28a-a9f3b5c901ae tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:41.755857 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c7baeed3-7618-459b-b28a-a9f3b5c901ae tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:41.756454 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c7baeed3-7618-459b-b28a-a9f3b5c901ae tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:41.757342 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c7baeed3-7618-459b-b28a-a9f3b5c901ae tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:41.757867 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c7baeed3-7618-459b-b28a-a9f3b5c901ae tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:41.841733 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c7baeed3-7618-459b-b28a-a9f3b5c901ae tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.098060 Oct 19 08:26:41.842590 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 271/535] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:41 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:41.846754 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-a5fdd7c6-9344-479d-a82e-0c06800e16fe tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:41.847660 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-a5fdd7c6-9344-479d-a82e-0c06800e16fe tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:41.854522 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a5fdd7c6-9344-479d-a82e-0c06800e16fe tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:41.854965 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a5fdd7c6-9344-479d-a82e-0c06800e16fe tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:41.855711 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a5fdd7c6-9344-479d-a82e-0c06800e16fe tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:41.856134 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a5fdd7c6-9344-479d-a82e-0c06800e16fe tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:42.210353 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-a5fdd7c6-9344-479d-a82e-0c06800e16fe tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.366970 Oct 19 08:26:42.214181 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 265/536] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:41 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:26:42.334023 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-bf1733be-50a6-4587-9812-6c89728597ce tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:42.335007 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-bf1733be-50a6-4587-9812-6c89728597ce tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:42.341332 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bf1733be-50a6-4587-9812-6c89728597ce tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:42.341766 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bf1733be-50a6-4587-9812-6c89728597ce tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:42.342534 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bf1733be-50a6-4587-9812-6c89728597ce tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:42.342957 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bf1733be-50a6-4587-9812-6c89728597ce tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:42.464847 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-bf1733be-50a6-4587-9812-6c89728597ce tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:42.472686 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-bf1733be-50a6-4587-9812-6c89728597ce tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1317 microversion: 2.1 time: 0.142833 Oct 19 08:26:42.473237 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 272/537] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:42 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:42.853767 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-863d4fff-e8eb-480c-b5cb-8ca5a9447864 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:42.854772 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-863d4fff-e8eb-480c-b5cb-8ca5a9447864 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:42.861102 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-863d4fff-e8eb-480c-b5cb-8ca5a9447864 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:42.861539 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-863d4fff-e8eb-480c-b5cb-8ca5a9447864 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:42.862287 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-863d4fff-e8eb-480c-b5cb-8ca5a9447864 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:42.862740 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-863d4fff-e8eb-480c-b5cb-8ca5a9447864 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:42.957648 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-863d4fff-e8eb-480c-b5cb-8ca5a9447864 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.107728 Oct 19 08:26:42.958288 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 266/538] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:42 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:43.189425 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ef33cb68-ab01-460d-bc75-863cb411dc1e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:43.190481 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ef33cb68-ab01-460d-bc75-863cb411dc1e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:43.197222 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ef33cb68-ab01-460d-bc75-863cb411dc1e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:43.197667 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ef33cb68-ab01-460d-bc75-863cb411dc1e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:43.198431 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ef33cb68-ab01-460d-bc75-863cb411dc1e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:43.198895 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ef33cb68-ab01-460d-bc75-863cb411dc1e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:43.221501 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-9fa72338-353b-4349-a242-2208f638b3d5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:43.221719 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.objects.instance [None req-ef33cb68-ab01-460d-bc75-863cb411dc1e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lazy-loading 'flavor' on Instance uuid a2a856f6-f552-461f-8d9c-4bf017cbbac5 {{(pid=114106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 19 08:26:43.222504 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-9fa72338-353b-4349-a242-2208f638b3d5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:43.229403 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9fa72338-353b-4349-a242-2208f638b3d5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:43.229848 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9fa72338-353b-4349-a242-2208f638b3d5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:43.230628 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9fa72338-353b-4349-a242-2208f638b3d5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:43.231062 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9fa72338-353b-4349-a242-2208f638b3d5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:43.300085 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-9fa72338-353b-4349-a242-2208f638b3d5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.082353 Oct 19 08:26:43.301268 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 267/539] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:43 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:26:43.337409 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ef33cb68-ab01-460d-bc75-863cb411dc1e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "POST /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5/action" status: 200 len: 32 microversion: 2.1 time: 0.151763 Oct 19 08:26:43.337997 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 273/540] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:43 2021] POST /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5/action => generated 32 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 08:26:43.347363 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-86c6279e-5062-4120-8591-9f2e1bfdba43 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:43.348132 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-86c6279e-5062-4120-8591-9f2e1bfdba43 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:43.355191 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-86c6279e-5062-4120-8591-9f2e1bfdba43 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:43.355637 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-86c6279e-5062-4120-8591-9f2e1bfdba43 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:43.356410 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-86c6279e-5062-4120-8591-9f2e1bfdba43 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:43.356832 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-86c6279e-5062-4120-8591-9f2e1bfdba43 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:43.490984 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-11f7c877-9285-4490-b40a-94948824faad tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:43.491662 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-11f7c877-9285-4490-b40a-94948824faad tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:43.497525 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-11f7c877-9285-4490-b40a-94948824faad tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:43.497967 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-11f7c877-9285-4490-b40a-94948824faad tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:43.498770 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-11f7c877-9285-4490-b40a-94948824faad tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:43.499197 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-11f7c877-9285-4490-b40a-94948824faad tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:43.578654 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-86c6279e-5062-4120-8591-9f2e1bfdba43 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:43.587093 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-86c6279e-5062-4120-8591-9f2e1bfdba43 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1521 microversion: 2.1 time: 0.243749 Oct 19 08:26:43.587947 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 268/541] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:43 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:26:43.735869 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-11f7c877-9285-4490-b40a-94948824faad tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:43.743870 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-11f7c877-9285-4490-b40a-94948824faad tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1317 microversion: 2.1 time: 0.257156 Oct 19 08:26:43.744289 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 274/542] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:43 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:26:43.969216 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-5069ba90-b79a-466d-8793-de0ef9f667f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:43.970135 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-5069ba90-b79a-466d-8793-de0ef9f667f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:43.976695 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5069ba90-b79a-466d-8793-de0ef9f667f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:43.977133 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5069ba90-b79a-466d-8793-de0ef9f667f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:43.977938 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5069ba90-b79a-466d-8793-de0ef9f667f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:43.978369 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5069ba90-b79a-466d-8793-de0ef9f667f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:44.069304 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-5069ba90-b79a-466d-8793-de0ef9f667f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.103546 Oct 19 08:26:44.073547 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 269/543] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:43 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:44.108696 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-4e657f58-21f5-455f-be23-e0123a24bf61 req-992a1fee-643b-4803-9ebf-b335cabaacc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b35fc67b-52d9-4e8f-a8a5-27826b508f1b", "name": "network-vif-plugged", "status": "completed", "tag": "e2b9fad3-3c12-4fab-ad0c-19ed2c6d2451"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:44.110424 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:26:44.110424 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:26:44.118924 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-4e657f58-21f5-455f-be23-e0123a24bf61 req-992a1fee-643b-4803-9ebf-b335cabaacc5 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:44.119481 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-4e657f58-21f5-455f-be23-e0123a24bf61 req-992a1fee-643b-4803-9ebf-b335cabaacc5 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:44.131061 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-4e657f58-21f5-455f-be23-e0123a24bf61 req-992a1fee-643b-4803-9ebf-b335cabaacc5 service nova] Creating event network-vif-plugged:e2b9fad3-3c12-4fab-ad0c-19ed2c6d2451 for instance b35fc67b-52d9-4e8f-a8a5-27826b508f1b on hv-cinder-81398 Oct 19 08:26:44.135694 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-4e657f58-21f5-455f-be23-e0123a24bf61 req-992a1fee-643b-4803-9ebf-b335cabaacc5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030694 Oct 19 08:26:44.136283 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 275/544] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:26:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:26:44.312215 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-bc2d2dd3-cb0e-4fb4-9fa6-faf7784ab33f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:44.313264 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-bc2d2dd3-cb0e-4fb4-9fa6-faf7784ab33f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:44.320191 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bc2d2dd3-cb0e-4fb4-9fa6-faf7784ab33f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:44.320635 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bc2d2dd3-cb0e-4fb4-9fa6-faf7784ab33f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:44.321402 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bc2d2dd3-cb0e-4fb4-9fa6-faf7784ab33f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:44.321833 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bc2d2dd3-cb0e-4fb4-9fa6-faf7784ab33f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:44.604966 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3b7f7be2-822d-4818-99cd-4bb6e7df9593 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:44.605638 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3b7f7be2-822d-4818-99cd-4bb6e7df9593 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:44.611622 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3b7f7be2-822d-4818-99cd-4bb6e7df9593 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:44.612057 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3b7f7be2-822d-4818-99cd-4bb6e7df9593 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:44.612799 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3b7f7be2-822d-4818-99cd-4bb6e7df9593 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:44.613218 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3b7f7be2-822d-4818-99cd-4bb6e7df9593 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:44.737006 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3b7f7be2-822d-4818-99cd-4bb6e7df9593 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:44.744877 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3b7f7be2-822d-4818-99cd-4bb6e7df9593 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1521 microversion: 2.1 time: 0.143858 Oct 19 08:26:44.745432 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 276/545] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:44 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:26:44.760088 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-81006a65-f95e-46d0-8e97-5eeb7e93f0f7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:44.760684 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-81006a65-f95e-46d0-8e97-5eeb7e93f0f7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:44.766190 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-81006a65-f95e-46d0-8e97-5eeb7e93f0f7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:44.766672 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-81006a65-f95e-46d0-8e97-5eeb7e93f0f7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:44.767430 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-81006a65-f95e-46d0-8e97-5eeb7e93f0f7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:44.767857 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-81006a65-f95e-46d0-8e97-5eeb7e93f0f7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:44.845637 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-bc2d2dd3-cb0e-4fb4-9fa6-faf7784ab33f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.537314 Oct 19 08:26:44.846524 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 270/546] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:44 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:26:44.892038 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-81006a65-f95e-46d0-8e97-5eeb7e93f0f7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:44.899592 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-81006a65-f95e-46d0-8e97-5eeb7e93f0f7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1317 microversion: 2.1 time: 0.142864 Oct 19 08:26:44.900144 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 277/547] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:44 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:26:45.081622 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2de36d57-bdcc-4cc9-b85d-8d9f074cf42b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:45.082865 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2de36d57-bdcc-4cc9-b85d-8d9f074cf42b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:45.089728 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2de36d57-bdcc-4cc9-b85d-8d9f074cf42b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:45.090175 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2de36d57-bdcc-4cc9-b85d-8d9f074cf42b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:45.090978 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2de36d57-bdcc-4cc9-b85d-8d9f074cf42b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:45.091420 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2de36d57-bdcc-4cc9-b85d-8d9f074cf42b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:45.159148 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2de36d57-bdcc-4cc9-b85d-8d9f074cf42b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.081252 Oct 19 08:26:45.159687 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 271/548] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:45 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:45.762343 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-506f831d-617a-4537-93fa-dc8e5de9ea68 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:45.762886 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-506f831d-617a-4537-93fa-dc8e5de9ea68 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:45.769055 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-506f831d-617a-4537-93fa-dc8e5de9ea68 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:45.769492 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-506f831d-617a-4537-93fa-dc8e5de9ea68 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:45.770256 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-506f831d-617a-4537-93fa-dc8e5de9ea68 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:45.770707 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-506f831d-617a-4537-93fa-dc8e5de9ea68 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:45.857573 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-1ec3d7f1-d4f0-49bd-8a67-68b9a6a58f54 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:45.858662 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-1ec3d7f1-d4f0-49bd-8a67-68b9a6a58f54 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:45.865094 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1ec3d7f1-d4f0-49bd-8a67-68b9a6a58f54 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:45.866099 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1ec3d7f1-d4f0-49bd-8a67-68b9a6a58f54 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:45.866970 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1ec3d7f1-d4f0-49bd-8a67-68b9a6a58f54 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:45.867459 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1ec3d7f1-d4f0-49bd-8a67-68b9a6a58f54 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:45.894159 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-506f831d-617a-4537-93fa-dc8e5de9ea68 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:45.902150 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-506f831d-617a-4537-93fa-dc8e5de9ea68 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1521 microversion: 2.1 time: 0.143445 Oct 19 08:26:45.902852 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 278/549] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:45 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:45.915677 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-f4b580ff-af21-4ed7-a640-ba1d38284685 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:45.916277 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-f4b580ff-af21-4ed7-a640-ba1d38284685 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:45.921931 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f4b580ff-af21-4ed7-a640-ba1d38284685 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:45.922373 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f4b580ff-af21-4ed7-a640-ba1d38284685 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:45.923163 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f4b580ff-af21-4ed7-a640-ba1d38284685 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:45.923592 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f4b580ff-af21-4ed7-a640-ba1d38284685 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:45.999745 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-1ec3d7f1-d4f0-49bd-8a67-68b9a6a58f54 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.145913 Oct 19 08:26:46.003192 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 272/550] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:45 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:26:46.043566 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-f4b580ff-af21-4ed7-a640-ba1d38284685 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:46.050855 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-f4b580ff-af21-4ed7-a640-ba1d38284685 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1317 microversion: 2.1 time: 0.138807 Oct 19 08:26:46.051402 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 279/551] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:45 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1317 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:26:46.171749 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-530a73e9-1ef9-40bb-a615-7ea9ee6b0097 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:46.172732 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-530a73e9-1ef9-40bb-a615-7ea9ee6b0097 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:46.180005 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-530a73e9-1ef9-40bb-a615-7ea9ee6b0097 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:46.180452 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-530a73e9-1ef9-40bb-a615-7ea9ee6b0097 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:46.181207 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-530a73e9-1ef9-40bb-a615-7ea9ee6b0097 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:46.181638 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-530a73e9-1ef9-40bb-a615-7ea9ee6b0097 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:46.274142 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-530a73e9-1ef9-40bb-a615-7ea9ee6b0097 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.106121 Oct 19 08:26:46.274704 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 273/552] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:46 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:46.919946 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ab21821d-b771-4447-a43e-81f2f92a05fb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:46.920496 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ab21821d-b771-4447-a43e-81f2f92a05fb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:46.926277 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ab21821d-b771-4447-a43e-81f2f92a05fb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:46.926748 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ab21821d-b771-4447-a43e-81f2f92a05fb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:46.927504 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ab21821d-b771-4447-a43e-81f2f92a05fb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:46.927967 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ab21821d-b771-4447-a43e-81f2f92a05fb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:47.016681 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d4c80853-7624-41d6-8026-4bbef40e8a61 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:47.017756 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-d4c80853-7624-41d6-8026-4bbef40e8a61 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:47.025956 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d4c80853-7624-41d6-8026-4bbef40e8a61 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:47.026392 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d4c80853-7624-41d6-8026-4bbef40e8a61 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:47.027206 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d4c80853-7624-41d6-8026-4bbef40e8a61 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:47.027910 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d4c80853-7624-41d6-8026-4bbef40e8a61 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:47.052088 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ab21821d-b771-4447-a43e-81f2f92a05fb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:47.060128 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ab21821d-b771-4447-a43e-81f2f92a05fb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1521 microversion: 2.1 time: 0.144201 Oct 19 08:26:47.060683 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 280/553] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:46 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:47.067739 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-290bc7c1-a0bd-4ea8-81b0-c01ad273e875 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:47.068340 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-290bc7c1-a0bd-4ea8-81b0-c01ad273e875 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:47.075377 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-290bc7c1-a0bd-4ea8-81b0-c01ad273e875 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:47.075836 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-290bc7c1-a0bd-4ea8-81b0-c01ad273e875 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:47.076597 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-290bc7c1-a0bd-4ea8-81b0-c01ad273e875 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:47.077023 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-290bc7c1-a0bd-4ea8-81b0-c01ad273e875 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:47.138064 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-d4c80853-7624-41d6-8026-4bbef40e8a61 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.126037 Oct 19 08:26:47.142076 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 274/554] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:47 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:26:47.202358 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-290bc7c1-a0bd-4ea8-81b0-c01ad273e875 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:47.209405 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-290bc7c1-a0bd-4ea8-81b0-c01ad273e875 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1317 microversion: 2.1 time: 0.145298 Oct 19 08:26:47.209962 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 281/555] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:47 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:26:47.286442 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-6d2f46bb-053a-4e81-a8ec-207a9a42f699 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:47.287474 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-6d2f46bb-053a-4e81-a8ec-207a9a42f699 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:47.293873 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6d2f46bb-053a-4e81-a8ec-207a9a42f699 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:47.294368 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6d2f46bb-053a-4e81-a8ec-207a9a42f699 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:47.295160 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6d2f46bb-053a-4e81-a8ec-207a9a42f699 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:47.295591 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6d2f46bb-053a-4e81-a8ec-207a9a42f699 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:47.395619 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-6d2f46bb-053a-4e81-a8ec-207a9a42f699 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.113488 Oct 19 08:26:47.396409 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 275/556] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:47 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:48.078514 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-5089284e-90bd-49d2-a828-f455ca299958 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:48.079144 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-5089284e-90bd-49d2-a828-f455ca299958 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:48.084934 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5089284e-90bd-49d2-a828-f455ca299958 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:48.085376 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5089284e-90bd-49d2-a828-f455ca299958 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:48.086244 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5089284e-90bd-49d2-a828-f455ca299958 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:48.086621 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5089284e-90bd-49d2-a828-f455ca299958 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:48.149897 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-57a9b311-9408-4a93-b509-44833b17b598 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:48.151019 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-57a9b311-9408-4a93-b509-44833b17b598 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:48.157703 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-57a9b311-9408-4a93-b509-44833b17b598 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:48.158237 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-57a9b311-9408-4a93-b509-44833b17b598 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:48.159060 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-57a9b311-9408-4a93-b509-44833b17b598 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:48.159491 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-57a9b311-9408-4a93-b509-44833b17b598 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:48.207277 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-5089284e-90bd-49d2-a828-f455ca299958 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:48.214527 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-5089284e-90bd-49d2-a828-f455ca299958 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1521 microversion: 2.1 time: 0.139711 Oct 19 08:26:48.215081 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 282/557] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:48 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1521 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:48.222856 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-57a9b311-9408-4a93-b509-44833b17b598 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.076987 Oct 19 08:26:48.224012 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 276/558] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:48 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:26:48.226881 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-9f04f616-80d0-4d94-b65e-3ff82b1974fc tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:48.227469 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-9f04f616-80d0-4d94-b65e-3ff82b1974fc tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:48.233193 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9f04f616-80d0-4d94-b65e-3ff82b1974fc tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:48.233628 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9f04f616-80d0-4d94-b65e-3ff82b1974fc tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:48.234374 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9f04f616-80d0-4d94-b65e-3ff82b1974fc tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:48.234819 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9f04f616-80d0-4d94-b65e-3ff82b1974fc tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:48.358082 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-9f04f616-80d0-4d94-b65e-3ff82b1974fc tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:48.365615 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-9f04f616-80d0-4d94-b65e-3ff82b1974fc tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1508 microversion: 2.1 time: 0.142145 Oct 19 08:26:48.366173 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 283/559] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:48 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1508 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:26:48.410538 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-122f14fe-ae7a-42f3-a1b8-595c9798ab6b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:48.411532 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-122f14fe-ae7a-42f3-a1b8-595c9798ab6b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:48.418433 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-122f14fe-ae7a-42f3-a1b8-595c9798ab6b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:48.418904 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-122f14fe-ae7a-42f3-a1b8-595c9798ab6b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:48.419668 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-122f14fe-ae7a-42f3-a1b8-595c9798ab6b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:48.420129 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-122f14fe-ae7a-42f3-a1b8-595c9798ab6b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:48.498443 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-122f14fe-ae7a-42f3-a1b8-595c9798ab6b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.091659 Oct 19 08:26:48.499761 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 277/560] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:48 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:49.232565 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-897351d3-0b9a-4cb8-bf4d-c17f8c9d9d82 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:49.233412 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-897351d3-0b9a-4cb8-bf4d-c17f8c9d9d82 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:49.235535 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2f7cb748-5c31-4621-8fce-5fb9d433074c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:49.236540 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2f7cb748-5c31-4621-8fce-5fb9d433074c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:49.239254 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-897351d3-0b9a-4cb8-bf4d-c17f8c9d9d82 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:49.239692 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-897351d3-0b9a-4cb8-bf4d-c17f8c9d9d82 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:49.240452 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-897351d3-0b9a-4cb8-bf4d-c17f8c9d9d82 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:49.240877 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-897351d3-0b9a-4cb8-bf4d-c17f8c9d9d82 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:49.243580 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2f7cb748-5c31-4621-8fce-5fb9d433074c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:49.244023 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2f7cb748-5c31-4621-8fce-5fb9d433074c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:49.244987 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2f7cb748-5c31-4621-8fce-5fb9d433074c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:49.245626 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2f7cb748-5c31-4621-8fce-5fb9d433074c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:49.332327 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2f7cb748-5c31-4621-8fce-5fb9d433074c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.100529 Oct 19 08:26:49.335289 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 278/561] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:49 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:26:49.381338 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-897351d3-0b9a-4cb8-bf4d-c17f8c9d9d82 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:49.388933 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-897351d3-0b9a-4cb8-bf4d-c17f8c9d9d82 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1521 microversion: 2.1 time: 0.160333 Oct 19 08:26:49.389501 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 284/562] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:49 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:49.511615 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-74680f29-9a7e-4bca-907f-ad211cb4c65c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:49.512526 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-74680f29-9a7e-4bca-907f-ad211cb4c65c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:49.518926 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-74680f29-9a7e-4bca-907f-ad211cb4c65c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:49.519372 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-74680f29-9a7e-4bca-907f-ad211cb4c65c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:49.520128 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-74680f29-9a7e-4bca-907f-ad211cb4c65c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:49.520560 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-74680f29-9a7e-4bca-907f-ad211cb4c65c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:49.588386 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-74680f29-9a7e-4bca-907f-ad211cb4c65c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.080887 Oct 19 08:26:49.592586 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 279/563] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:49 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:50.343916 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-91ac562c-d98d-4820-99e3-407710dea440 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:50.345095 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-91ac562c-d98d-4820-99e3-407710dea440 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:50.352180 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-91ac562c-d98d-4820-99e3-407710dea440 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:50.352710 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-91ac562c-d98d-4820-99e3-407710dea440 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:50.353475 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-91ac562c-d98d-4820-99e3-407710dea440 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:50.353897 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-91ac562c-d98d-4820-99e3-407710dea440 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:50.406756 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-232b687d-bf6e-45f2-9dbe-3492f11ca2e1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:50.407619 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-232b687d-bf6e-45f2-9dbe-3492f11ca2e1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:50.414243 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-232b687d-bf6e-45f2-9dbe-3492f11ca2e1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:50.414720 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-232b687d-bf6e-45f2-9dbe-3492f11ca2e1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:50.415531 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-232b687d-bf6e-45f2-9dbe-3492f11ca2e1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:50.415907 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-232b687d-bf6e-45f2-9dbe-3492f11ca2e1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:50.504545 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-91ac562c-d98d-4820-99e3-407710dea440 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.164235 Oct 19 08:26:50.506606 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 285/564] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:50 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:26:50.543293 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-232b687d-bf6e-45f2-9dbe-3492f11ca2e1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:50.550618 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-232b687d-bf6e-45f2-9dbe-3492f11ca2e1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1521 microversion: 2.1 time: 0.148438 Oct 19 08:26:50.551173 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 280/565] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:50 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:26:50.600309 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-423c2284-312e-4c10-974e-a7a23a1770b7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:50.601432 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-423c2284-312e-4c10-974e-a7a23a1770b7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:50.608032 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-423c2284-312e-4c10-974e-a7a23a1770b7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:50.608506 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-423c2284-312e-4c10-974e-a7a23a1770b7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:50.609309 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-423c2284-312e-4c10-974e-a7a23a1770b7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:50.609740 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-423c2284-312e-4c10-974e-a7a23a1770b7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:50.677750 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-423c2284-312e-4c10-974e-a7a23a1770b7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.081504 Oct 19 08:26:50.678562 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 286/566] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:50 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:50.729949 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-807914bb-1026-476c-bc6e-8c6738489ec2 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9730c7dc-24ac-43cb-b64a-f206a03f9a3e"}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:50.731029 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-807914bb-1026-476c-bc6e-8c6738489ec2 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:50.736821 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-807914bb-1026-476c-bc6e-8c6738489ec2 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:50.737284 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-807914bb-1026-476c-bc6e-8c6738489ec2 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:50.738037 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-807914bb-1026-476c-bc6e-8c6738489ec2 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:50.738456 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-807914bb-1026-476c-bc6e-8c6738489ec2 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:50.979569 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-807914bb-1026-476c-bc6e-8c6738489ec2 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "POST /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254126 Oct 19 08:26:50.980157 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 281/567] 10.222.0.26 () {60 vars in 1322 bytes} [Tue Oct 19 08:26:50 2021] POST /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:26:51.517733 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-69a5d9a6-382d-4354-8914-71920a3c1e57 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:51.518776 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-69a5d9a6-382d-4354-8914-71920a3c1e57 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:51.525128 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-69a5d9a6-382d-4354-8914-71920a3c1e57 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:51.525570 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-69a5d9a6-382d-4354-8914-71920a3c1e57 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:51.526317 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-69a5d9a6-382d-4354-8914-71920a3c1e57 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:51.526767 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-69a5d9a6-382d-4354-8914-71920a3c1e57 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:51.568236 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c91be354-e47d-489d-87a2-de7a125443f3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:51.568923 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-c91be354-e47d-489d-87a2-de7a125443f3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:51.575097 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c91be354-e47d-489d-87a2-de7a125443f3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:51.575484 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c91be354-e47d-489d-87a2-de7a125443f3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:51.577535 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c91be354-e47d-489d-87a2-de7a125443f3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:51.577535 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c91be354-e47d-489d-87a2-de7a125443f3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:51.594353 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-69a5d9a6-382d-4354-8914-71920a3c1e57 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.080534 Oct 19 08:26:51.595139 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 287/568] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:51 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:26:51.690020 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-356d4b47-b318-40ca-aa40-7a89e2a806d1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:51.691248 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-356d4b47-b318-40ca-aa40-7a89e2a806d1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:51.698348 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-356d4b47-b318-40ca-aa40-7a89e2a806d1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:51.698818 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-356d4b47-b318-40ca-aa40-7a89e2a806d1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:51.699588 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-356d4b47-b318-40ca-aa40-7a89e2a806d1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:51.700018 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-356d4b47-b318-40ca-aa40-7a89e2a806d1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:51.704798 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-c91be354-e47d-489d-87a2-de7a125443f3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:51.712176 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-c91be354-e47d-489d-87a2-de7a125443f3 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1521 microversion: 2.1 time: 0.147860 Oct 19 08:26:51.712977 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 282/569] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:51 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:26:51.765590 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-356d4b47-b318-40ca-aa40-7a89e2a806d1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.079505 Oct 19 08:26:51.766245 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 288/570] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:51 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:26:52.606633 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c7c54bf8-5b80-4845-b82d-195b44771e54 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:52.607630 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-c7c54bf8-5b80-4845-b82d-195b44771e54 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:52.613768 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c7c54bf8-5b80-4845-b82d-195b44771e54 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:52.614212 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c7c54bf8-5b80-4845-b82d-195b44771e54 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:52.615018 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c7c54bf8-5b80-4845-b82d-195b44771e54 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:52.615480 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c7c54bf8-5b80-4845-b82d-195b44771e54 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:52.730344 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e2f67589-a4fb-48fe-bcad-2669e6ed6e2c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:52.731143 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e2f67589-a4fb-48fe-bcad-2669e6ed6e2c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:52.737643 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e2f67589-a4fb-48fe-bcad-2669e6ed6e2c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:52.738077 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e2f67589-a4fb-48fe-bcad-2669e6ed6e2c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:52.738873 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e2f67589-a4fb-48fe-bcad-2669e6ed6e2c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:52.739296 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e2f67589-a4fb-48fe-bcad-2669e6ed6e2c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:52.747840 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-c7c54bf8-5b80-4845-b82d-195b44771e54 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.145514 Oct 19 08:26:52.748478 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 283/571] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:52 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:26:52.777985 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-825aed27-6243-4852-8bf2-93dfd55c8b7c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:52.779008 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-825aed27-6243-4852-8bf2-93dfd55c8b7c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:52.785311 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-825aed27-6243-4852-8bf2-93dfd55c8b7c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:52.785751 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-825aed27-6243-4852-8bf2-93dfd55c8b7c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:52.786537 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-825aed27-6243-4852-8bf2-93dfd55c8b7c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:52.786970 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-825aed27-6243-4852-8bf2-93dfd55c8b7c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:52.858609 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-825aed27-6243-4852-8bf2-93dfd55c8b7c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.084675 Oct 19 08:26:52.862604 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 284/572] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:52 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:26:52.862890 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-e2f67589-a4fb-48fe-bcad-2669e6ed6e2c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:52.870706 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e2f67589-a4fb-48fe-bcad-2669e6ed6e2c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1521 microversion: 2.1 time: 0.145107 Oct 19 08:26:52.871255 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 289/573] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:52 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:26:53.760675 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-dde53fa1-c575-46e1-9c2a-c2fa586f81fb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:53.761664 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-dde53fa1-c575-46e1-9c2a-c2fa586f81fb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:53.768037 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dde53fa1-c575-46e1-9c2a-c2fa586f81fb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:53.768477 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dde53fa1-c575-46e1-9c2a-c2fa586f81fb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:53.769230 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dde53fa1-c575-46e1-9c2a-c2fa586f81fb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:53.769658 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dde53fa1-c575-46e1-9c2a-c2fa586f81fb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:53.870171 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-6d932bf3-a86d-4d78-b7ad-b7d60ee7e30e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:53.871104 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-6d932bf3-a86d-4d78-b7ad-b7d60ee7e30e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:53.877181 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6d932bf3-a86d-4d78-b7ad-b7d60ee7e30e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:53.877623 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6d932bf3-a86d-4d78-b7ad-b7d60ee7e30e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:53.878377 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6d932bf3-a86d-4d78-b7ad-b7d60ee7e30e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:53.878839 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6d932bf3-a86d-4d78-b7ad-b7d60ee7e30e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:53.891878 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-dde53fa1-c575-46e1-9c2a-c2fa586f81fb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.135483 Oct 19 08:26:53.892814 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 285/574] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:53 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:26:53.897491 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8be72a0d-34df-4e13-9ec1-295664248050 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:53.898193 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-8be72a0d-34df-4e13-9ec1-295664248050 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:53.905502 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8be72a0d-34df-4e13-9ec1-295664248050 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:53.905939 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8be72a0d-34df-4e13-9ec1-295664248050 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:53.906770 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8be72a0d-34df-4e13-9ec1-295664248050 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:53.907252 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8be72a0d-34df-4e13-9ec1-295664248050 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:53.946750 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-6d932bf3-a86d-4d78-b7ad-b7d60ee7e30e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.079979 Oct 19 08:26:53.947970 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 290/575] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:53 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:26:54.026579 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-8be72a0d-34df-4e13-9ec1-295664248050 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:54.033769 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-8be72a0d-34df-4e13-9ec1-295664248050 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1521 microversion: 2.1 time: 0.140000 Oct 19 08:26:54.034321 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 286/576] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:53 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1521 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:54.904097 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-585013d2-d359-41ac-8377-2abe11bd125d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:54.905096 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-585013d2-d359-41ac-8377-2abe11bd125d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:54.911454 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-585013d2-d359-41ac-8377-2abe11bd125d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:54.911907 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-585013d2-d359-41ac-8377-2abe11bd125d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:54.912659 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-585013d2-d359-41ac-8377-2abe11bd125d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:54.913089 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-585013d2-d359-41ac-8377-2abe11bd125d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:54.958795 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-812afeac-90a0-4039-af0b-0759502268b1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:54.959617 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-812afeac-90a0-4039-af0b-0759502268b1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:54.966398 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-812afeac-90a0-4039-af0b-0759502268b1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:54.966868 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-812afeac-90a0-4039-af0b-0759502268b1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:54.967626 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-812afeac-90a0-4039-af0b-0759502268b1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:54.968159 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-812afeac-90a0-4039-af0b-0759502268b1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:54.997032 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-585013d2-d359-41ac-8377-2abe11bd125d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.097185 Oct 19 08:26:54.998281 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 291/577] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:54 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:26:55.038951 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-812afeac-90a0-4039-af0b-0759502268b1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.083655 Oct 19 08:26:55.039811 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 287/578] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:54 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:26:55.050767 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c911d486-74ac-4caa-b534-e1326bc6669b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:55.051461 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c911d486-74ac-4caa-b534-e1326bc6669b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:55.058058 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c911d486-74ac-4caa-b534-e1326bc6669b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:55.058528 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c911d486-74ac-4caa-b534-e1326bc6669b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:55.059293 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c911d486-74ac-4caa-b534-e1326bc6669b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:55.059725 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c911d486-74ac-4caa-b534-e1326bc6669b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:55.184954 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-c911d486-74ac-4caa-b534-e1326bc6669b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:55.192203 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c911d486-74ac-4caa-b534-e1326bc6669b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1521 microversion: 2.1 time: 0.145372 Oct 19 08:26:55.192758 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 292/579] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:55 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:56.010119 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-447aab7f-06f4-44aa-8ec0-3b2c58d503ab tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:56.011144 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-447aab7f-06f4-44aa-8ec0-3b2c58d503ab tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:56.017514 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-447aab7f-06f4-44aa-8ec0-3b2c58d503ab tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:56.017957 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-447aab7f-06f4-44aa-8ec0-3b2c58d503ab tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:56.018748 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-447aab7f-06f4-44aa-8ec0-3b2c58d503ab tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:56.019183 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-447aab7f-06f4-44aa-8ec0-3b2c58d503ab tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:56.049994 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-d234da2c-203e-495a-95e3-e5da62eba11c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:56.050934 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-d234da2c-203e-495a-95e3-e5da62eba11c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:56.057075 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d234da2c-203e-495a-95e3-e5da62eba11c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:56.057530 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d234da2c-203e-495a-95e3-e5da62eba11c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:56.058321 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d234da2c-203e-495a-95e3-e5da62eba11c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:56.058781 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d234da2c-203e-495a-95e3-e5da62eba11c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:56.099052 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-447aab7f-06f4-44aa-8ec0-3b2c58d503ab tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.093496 Oct 19 08:26:56.099695 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 288/580] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:56 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:26:56.148938 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-d234da2c-203e-495a-95e3-e5da62eba11c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.102510 Oct 19 08:26:56.149551 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 293/581] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:56 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:26:56.209212 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-186466f0-0d0a-4c33-80f4-340d2ecffd22 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:56.209895 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-186466f0-0d0a-4c33-80f4-340d2ecffd22 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:56.216992 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-186466f0-0d0a-4c33-80f4-340d2ecffd22 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:56.217435 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-186466f0-0d0a-4c33-80f4-340d2ecffd22 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:56.218216 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-186466f0-0d0a-4c33-80f4-340d2ecffd22 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:56.218679 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-186466f0-0d0a-4c33-80f4-340d2ecffd22 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:56.338084 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-186466f0-0d0a-4c33-80f4-340d2ecffd22 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:56.345242 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-186466f0-0d0a-4c33-80f4-340d2ecffd22 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1521 microversion: 2.1 time: 0.139943 Oct 19 08:26:56.345792 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 289/582] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:56 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1521 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:57.111047 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a537a652-20bb-4f97-86ec-5395ecf39c4b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:57.112043 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a537a652-20bb-4f97-86ec-5395ecf39c4b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:57.118351 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a537a652-20bb-4f97-86ec-5395ecf39c4b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:57.118861 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a537a652-20bb-4f97-86ec-5395ecf39c4b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:57.119841 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a537a652-20bb-4f97-86ec-5395ecf39c4b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:57.120272 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a537a652-20bb-4f97-86ec-5395ecf39c4b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:57.160784 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2fc35b85-a139-449c-b8db-ad556732d1fa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:57.161692 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2fc35b85-a139-449c-b8db-ad556732d1fa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:57.168091 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2fc35b85-a139-449c-b8db-ad556732d1fa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:57.168531 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2fc35b85-a139-449c-b8db-ad556732d1fa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:57.169287 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2fc35b85-a139-449c-b8db-ad556732d1fa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:57.169716 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2fc35b85-a139-449c-b8db-ad556732d1fa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:57.297224 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2fc35b85-a139-449c-b8db-ad556732d1fa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.139889 Oct 19 08:26:57.301168 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 290/583] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:57 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:26:57.303181 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a537a652-20bb-4f97-86ec-5395ecf39c4b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.195868 Oct 19 08:26:57.303796 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 294/584] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:57 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:26:57.363087 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-f4007bc7-0b80-4ff9-babb-e8290f2669f6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:57.363708 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-f4007bc7-0b80-4ff9-babb-e8290f2669f6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:57.370014 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f4007bc7-0b80-4ff9-babb-e8290f2669f6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:57.370448 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f4007bc7-0b80-4ff9-babb-e8290f2669f6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:57.371245 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f4007bc7-0b80-4ff9-babb-e8290f2669f6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:57.371669 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f4007bc7-0b80-4ff9-babb-e8290f2669f6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:57.497227 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-f4007bc7-0b80-4ff9-babb-e8290f2669f6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:57.504535 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-f4007bc7-0b80-4ff9-babb-e8290f2669f6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1521 microversion: 2.1 time: 0.145447 Oct 19 08:26:57.505097 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 291/585] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:57 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:58.309957 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-36aeb88c-2041-4868-ad10-09afd84bfd62 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:58.310870 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-36aeb88c-2041-4868-ad10-09afd84bfd62 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:58.314707 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-37b9a865-84ee-414a-93d2-9675523942db tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:58.315618 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-37b9a865-84ee-414a-93d2-9675523942db tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:58.317245 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-36aeb88c-2041-4868-ad10-09afd84bfd62 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:58.317679 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-36aeb88c-2041-4868-ad10-09afd84bfd62 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:58.318431 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-36aeb88c-2041-4868-ad10-09afd84bfd62 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:58.318878 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-36aeb88c-2041-4868-ad10-09afd84bfd62 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:58.321313 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-37b9a865-84ee-414a-93d2-9675523942db tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:58.321762 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-37b9a865-84ee-414a-93d2-9675523942db tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:58.322548 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-37b9a865-84ee-414a-93d2-9675523942db tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:58.322991 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-37b9a865-84ee-414a-93d2-9675523942db tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:58.384402 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-36aeb88c-2041-4868-ad10-09afd84bfd62 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.078951 Oct 19 08:26:58.385787 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 295/586] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:58 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:58.402790 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-37b9a865-84ee-414a-93d2-9675523942db tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.091430 Oct 19 08:26:58.403645 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 292/587] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:58 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:26:58.441593 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c37f21c8-9f93-4438-8bd0-148b0e0f0c0c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9730c7dc-24ac-43cb-b64a-f206a03f9a3e"}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:58.442739 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c37f21c8-9f93-4438-8bd0-148b0e0f0c0c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:58.449304 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c37f21c8-9f93-4438-8bd0-148b0e0f0c0c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:58.449738 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c37f21c8-9f93-4438-8bd0-148b0e0f0c0c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:58.450482 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c37f21c8-9f93-4438-8bd0-148b0e0f0c0c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:58.450924 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c37f21c8-9f93-4438-8bd0-148b0e0f0c0c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:58.522636 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-6ff5d901-bf16-43ed-8975-7f236c98d16f tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:58.523321 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-6ff5d901-bf16-43ed-8975-7f236c98d16f tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:58.526604 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.wsgi [None req-c37f21c8-9f93-4438-8bd0-148b0e0f0c0c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] HTTP exception thrown: Invalid volume: volume 9730c7dc-24ac-43cb-b64a-f206a03f9a3e is already attached to instances: b35fc67b-52d9-4e8f-a8a5-27826b508f1b Oct 19 08:26:58.527211 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c37f21c8-9f93-4438-8bd0-148b0e0f0c0c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Returning 400 to user: Invalid volume: volume 9730c7dc-24ac-43cb-b64a-f206a03f9a3e is already attached to instances: b35fc67b-52d9-4e8f-a8a5-27826b508f1b {{(pid=114106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:26:58.528031 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c37f21c8-9f93-4438-8bd0-148b0e0f0c0c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "POST /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.090631 Oct 19 08:26:58.528751 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 296/588] 10.222.0.26 () {60 vars in 1322 bytes} [Tue Oct 19 08:26:58 2021] POST /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b/os-volume_attachments => generated 174 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 08:26:58.530290 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6ff5d901-bf16-43ed-8975-7f236c98d16f tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:58.530763 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6ff5d901-bf16-43ed-8975-7f236c98d16f tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:58.531529 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6ff5d901-bf16-43ed-8975-7f236c98d16f tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:58.531959 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6ff5d901-bf16-43ed-8975-7f236c98d16f tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:58.584742 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-944b2422-55b7-4a57-938f-76807f4b67f3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:58.585235 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-944b2422-55b7-4a57-938f-76807f4b67f3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:58.591600 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-944b2422-55b7-4a57-938f-76807f4b67f3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:58.592068 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-944b2422-55b7-4a57-938f-76807f4b67f3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:58.592827 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-944b2422-55b7-4a57-938f-76807f4b67f3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:58.593253 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-944b2422-55b7-4a57-938f-76807f4b67f3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:58.656026 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-6ff5d901-bf16-43ed-8975-7f236c98d16f tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:58.663270 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-6ff5d901-bf16-43ed-8975-7f236c98d16f tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1521 microversion: 2.1 time: 0.144585 Oct 19 08:26:58.663818 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 293/589] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:58 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:58.671210 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.objects.instance [None req-944b2422-55b7-4a57-938f-76807f4b67f3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lazy-loading 'services' on Instance uuid b35fc67b-52d9-4e8f-a8a5-27826b508f1b {{(pid=114106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 19 08:26:58.739669 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-944b2422-55b7-4a57-938f-76807f4b67f3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b/os-volume_attachments/9730c7dc-24ac-43cb-b64a-f206a03f9a3e" status: 202 len: 0 microversion: 2.1 time: 0.158455 Oct 19 08:26:58.740430 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 297/590] 10.222.0.26 () {58 vars in 1415 bytes} [Tue Oct 19 08:26:58 2021] DELETE /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b/os-volume_attachments/9730c7dc-24ac-43cb-b64a-f206a03f9a3e => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:26:58.749259 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-87aedba2-ec80-4a94-8cce-5aca1865af36 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:58.750174 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-87aedba2-ec80-4a94-8cce-5aca1865af36 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:58.757126 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-87aedba2-ec80-4a94-8cce-5aca1865af36 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:58.757862 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-87aedba2-ec80-4a94-8cce-5aca1865af36 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:58.758881 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-87aedba2-ec80-4a94-8cce-5aca1865af36 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:58.759318 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-87aedba2-ec80-4a94-8cce-5aca1865af36 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:58.792599 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-87aedba2-ec80-4a94-8cce-5aca1865af36 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047700 Oct 19 08:26:58.793147 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 294/591] 10.222.0.26 () {58 vars in 1301 bytes} [Tue Oct 19 08:26:58 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:26:59.396477 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-9ab75b95-bd74-4651-883a-53d1947662e6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:59.397513 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-9ab75b95-bd74-4651-883a-53d1947662e6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:59.403776 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9ab75b95-bd74-4651-883a-53d1947662e6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:59.404210 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9ab75b95-bd74-4651-883a-53d1947662e6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:59.404962 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9ab75b95-bd74-4651-883a-53d1947662e6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:59.405385 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9ab75b95-bd74-4651-883a-53d1947662e6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:59.414532 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2484ec9e-d576-49fa-8a35-4dc896fd5979 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:26:59.415446 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2484ec9e-d576-49fa-8a35-4dc896fd5979 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:59.421541 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2484ec9e-d576-49fa-8a35-4dc896fd5979 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:59.421980 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2484ec9e-d576-49fa-8a35-4dc896fd5979 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:59.422771 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2484ec9e-d576-49fa-8a35-4dc896fd5979 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:59.423201 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2484ec9e-d576-49fa-8a35-4dc896fd5979 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:59.493523 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2484ec9e-d576-49fa-8a35-4dc896fd5979 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.082667 Oct 19 08:26:59.494994 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 295/592] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:26:59 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:26:59.503319 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-9ab75b95-bd74-4651-883a-53d1947662e6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.110759 Oct 19 08:26:59.503995 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 298/593] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:26:59 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:26:59.680620 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-3e0221a2-7e34-487d-8723-3dea3c5ffd2d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:59.681965 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-3e0221a2-7e34-487d-8723-3dea3c5ffd2d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:59.690775 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3e0221a2-7e34-487d-8723-3dea3c5ffd2d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:59.691396 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3e0221a2-7e34-487d-8723-3dea3c5ffd2d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:59.692287 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3e0221a2-7e34-487d-8723-3dea3c5ffd2d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:59.692822 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3e0221a2-7e34-487d-8723-3dea3c5ffd2d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:59.804061 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c6d57fd9-ca60-4d95-8db6-72422fa2a198 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:26:59.805045 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c6d57fd9-ca60-4d95-8db6-72422fa2a198 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:26:59.812092 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c6d57fd9-ca60-4d95-8db6-72422fa2a198 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:59.812527 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c6d57fd9-ca60-4d95-8db6-72422fa2a198 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:59.813282 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c6d57fd9-ca60-4d95-8db6-72422fa2a198 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:26:59.813703 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c6d57fd9-ca60-4d95-8db6-72422fa2a198 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:26:59.822469 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-3e0221a2-7e34-487d-8723-3dea3c5ffd2d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:26:59.829858 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-3e0221a2-7e34-487d-8723-3dea3c5ffd2d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1521 microversion: 2.1 time: 0.153334 Oct 19 08:26:59.830520 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 296/594] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:26:59 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:26:59.842288 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c6d57fd9-ca60-4d95-8db6-72422fa2a198 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042378 Oct 19 08:26:59.842846 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 299/595] 10.222.0.26 () {58 vars in 1301 bytes} [Tue Oct 19 08:26:59 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 08:26:59.965433 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-dd009dd1-2d60-402e-a80f-328c24bfeec5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-875841713", "imageRef": "9102a998-a580-4b4e-b6a1-3172273dd66d", "flavorRef": "452", "networks": [{"uuid": "fbed0243-7d71-4fc4-9caf-afbd08f9b31f"}]}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:00.018481 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.network.neutron [None req-dd009dd1-2d60-402e-a80f-328c24bfeec5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] validate_networks() for [('fbed0243-7d71-4fc4-9caf-afbd08f9b31f', None, None, None, None, None)] {{(pid=114105) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 19 08:27:00.373024 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-dd009dd1-2d60-402e-a80f-328c24bfeec5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Flavor limits 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 08:27:00.373445 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-dd009dd1-2d60-402e-a80f-328c24bfeec5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Image limits 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 08:27:00.373918 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-dd009dd1-2d60-402e-a80f-328c24bfeec5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Flavor pref 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 08:27:00.374318 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-dd009dd1-2d60-402e-a80f-328c24bfeec5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Image pref 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 08:27:00.374752 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-dd009dd1-2d60-402e-a80f-328c24bfeec5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 08:27:00.383463 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dd009dd1-2d60-402e-a80f-328c24bfeec5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:00.383905 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dd009dd1-2d60-402e-a80f-328c24bfeec5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:00.384903 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dd009dd1-2d60-402e-a80f-328c24bfeec5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:00.385350 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dd009dd1-2d60-402e-a80f-328c24bfeec5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:00.401822 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-dd009dd1-2d60-402e-a80f-328c24bfeec5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Getting quotas for project d1e6b0972cf140649ed2cad14f2db0b4. Resources: {'cores', 'instances', 'ram'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:27:00.405838 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-dd009dd1-2d60-402e-a80f-328c24bfeec5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Getting quotas for user bb3db95dc956487ead5e579b58451580 and project d1e6b0972cf140649ed2cad14f2db0b4. Resources: {'cores', 'instances', 'ram'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:27:00.417050 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-dd009dd1-2d60-402e-a80f-328c24bfeec5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Going to run 1 instances... {{(pid=114105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 19 08:27:00.419370 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-dd009dd1-2d60-402e-a80f-328c24bfeec5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9102a998-a580-4b4e-b6a1-3172273dd66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 19 08:27:00.463369 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-dd009dd1-2d60-402e-a80f-328c24bfeec5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.501551 Oct 19 08:27:00.464006 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 297/596] 10.222.0.26 () {60 vars in 1146 bytes} [Tue Oct 19 08:26:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 08:27:00.473544 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-f5b7dee9-bb3b-4755-b3b4-4a47beb5e673 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:00.474153 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-f5b7dee9-bb3b-4755-b3b4-4a47beb5e673 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:00.505638 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-6b521cc4-0f26-4e2f-9271-c9b86170afd3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:00.506731 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-6b521cc4-0f26-4e2f-9271-c9b86170afd3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:00.512827 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b521cc4-0f26-4e2f-9271-c9b86170afd3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:00.513279 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b521cc4-0f26-4e2f-9271-c9b86170afd3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:00.514059 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b521cc4-0f26-4e2f-9271-c9b86170afd3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:00.514522 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b521cc4-0f26-4e2f-9271-c9b86170afd3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:00.536189 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-f5b7dee9-bb3b-4755-b3b4-4a47beb5e673 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:00.543199 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-f5b7dee9-bb3b-4755-b3b4-4a47beb5e673 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6" status: 200 len: 1217 microversion: 2.1 time: 0.073225 Oct 19 08:27:00.543770 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 300/597] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:00 2021] GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6 => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:00.550534 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e82acdbf-1443-4237-b42d-b23fcf965c4e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:00.550534 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e82acdbf-1443-4237-b42d-b23fcf965c4e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:00.554527 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e82acdbf-1443-4237-b42d-b23fcf965c4e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:00.554962 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e82acdbf-1443-4237-b42d-b23fcf965c4e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:00.555723 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e82acdbf-1443-4237-b42d-b23fcf965c4e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:00.556151 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e82acdbf-1443-4237-b42d-b23fcf965c4e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:00.601360 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-6b521cc4-0f26-4e2f-9271-c9b86170afd3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.099852 Oct 19 08:27:00.602084 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 298/598] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:00 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:27:00.635239 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e82acdbf-1443-4237-b42d-b23fcf965c4e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.090055 Oct 19 08:27:00.636223 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 301/599] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:00 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:27:00.847577 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-b9125ceb-c729-4a94-bb27-3d46ed7cf747 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:00.848264 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-b9125ceb-c729-4a94-bb27-3d46ed7cf747 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:00.855546 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b9125ceb-c729-4a94-bb27-3d46ed7cf747 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:00.855993 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b9125ceb-c729-4a94-bb27-3d46ed7cf747 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:00.856764 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b9125ceb-c729-4a94-bb27-3d46ed7cf747 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:00.857196 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b9125ceb-c729-4a94-bb27-3d46ed7cf747 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:00.986457 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-b9125ceb-c729-4a94-bb27-3d46ed7cf747 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:00.994409 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-b9125ceb-c729-4a94-bb27-3d46ed7cf747 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1521 microversion: 2.1 time: 0.150661 Oct 19 08:27:00.995335 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 299/600] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:00 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:01.561323 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-7a3ca8a8-21e8-4391-9987-819d97494173 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:01.562015 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-7a3ca8a8-21e8-4391-9987-819d97494173 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:01.568760 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7a3ca8a8-21e8-4391-9987-819d97494173 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:01.569216 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7a3ca8a8-21e8-4391-9987-819d97494173 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:01.569971 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7a3ca8a8-21e8-4391-9987-819d97494173 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:01.570376 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7a3ca8a8-21e8-4391-9987-819d97494173 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:01.615615 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8accc2ae-6019-46be-b994-e6f418e799c6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:01.616879 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-8accc2ae-6019-46be-b994-e6f418e799c6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:01.623549 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8accc2ae-6019-46be-b994-e6f418e799c6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:01.624096 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8accc2ae-6019-46be-b994-e6f418e799c6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:01.624992 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8accc2ae-6019-46be-b994-e6f418e799c6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:01.625535 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8accc2ae-6019-46be-b994-e6f418e799c6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:01.654741 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-7a3ca8a8-21e8-4391-9987-819d97494173 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:01.665204 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-7a3ca8a8-21e8-4391-9987-819d97494173 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6" status: 200 len: 1275 microversion: 2.1 time: 0.108526 Oct 19 08:27:01.666005 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 302/601] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:01 2021] GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6 => generated 1275 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:01.671623 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-6243f087-45f4-4dbc-a717-a5ba0f115b4c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:01.672864 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-6243f087-45f4-4dbc-a717-a5ba0f115b4c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:01.678547 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6243f087-45f4-4dbc-a717-a5ba0f115b4c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:01.678998 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6243f087-45f4-4dbc-a717-a5ba0f115b4c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:01.679792 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6243f087-45f4-4dbc-a717-a5ba0f115b4c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:01.680221 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6243f087-45f4-4dbc-a717-a5ba0f115b4c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:01.712211 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-8accc2ae-6019-46be-b994-e6f418e799c6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.101533 Oct 19 08:27:01.712903 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 300/602] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:01 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:27:01.816924 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-6243f087-45f4-4dbc-a717-a5ba0f115b4c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.149809 Oct 19 08:27:01.820764 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 303/603] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:01 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:27:02.012674 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-e55be9e1-2f34-480a-b0d3-d211e2ce7b79 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:02.013371 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-e55be9e1-2f34-480a-b0d3-d211e2ce7b79 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:02.020863 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e55be9e1-2f34-480a-b0d3-d211e2ce7b79 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:02.021323 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e55be9e1-2f34-480a-b0d3-d211e2ce7b79 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:02.022132 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e55be9e1-2f34-480a-b0d3-d211e2ce7b79 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:02.022658 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e55be9e1-2f34-480a-b0d3-d211e2ce7b79 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:02.205625 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-49728159-7898-43d9-a01c-af84bed58886 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "996a18fa-a154-47f6-8f8b-724f574a7cbf", "device": "/dev/sdb"}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:02.208097 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-49728159-7898-43d9-a01c-af84bed58886 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: 61889472-0e20-46bc-94d3-c4c42883a5b4] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:02.215284 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-49728159-7898-43d9-a01c-af84bed58886 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:02.216474 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-49728159-7898-43d9-a01c-af84bed58886 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:02.217422 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-49728159-7898-43d9-a01c-af84bed58886 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:02.218169 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-49728159-7898-43d9-a01c-af84bed58886 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:02.269556 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-e55be9e1-2f34-480a-b0d3-d211e2ce7b79 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:02.276855 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-e55be9e1-2f34-480a-b0d3-d211e2ce7b79 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1521 microversion: 2.1 time: 0.268373 Oct 19 08:27:02.280229 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 301/604] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:02 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:02.614610 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-49728159-7898-43d9-a01c-af84bed58886 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "POST /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.413121 Oct 19 08:27:02.615844 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 304/605] 10.222.0.26 () {60 vars in 1322 bytes} [Tue Oct 19 08:27:02 2021] POST /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4/os-volume_attachments => generated 194 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 08:27:02.683316 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-eeb73697-0bb8-460e-bef3-6680d63b94ea tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:02.683995 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-eeb73697-0bb8-460e-bef3-6680d63b94ea tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:02.690652 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-eeb73697-0bb8-460e-bef3-6680d63b94ea tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:02.691310 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-eeb73697-0bb8-460e-bef3-6680d63b94ea tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:02.692084 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-eeb73697-0bb8-460e-bef3-6680d63b94ea tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:02.692690 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-eeb73697-0bb8-460e-bef3-6680d63b94ea tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:02.726567 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3ac2d7ed-67ab-4d29-b419-4acd6a5c5f78 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:02.727717 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3ac2d7ed-67ab-4d29-b419-4acd6a5c5f78 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:02.735428 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3ac2d7ed-67ab-4d29-b419-4acd6a5c5f78 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:02.735938 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3ac2d7ed-67ab-4d29-b419-4acd6a5c5f78 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:02.736762 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3ac2d7ed-67ab-4d29-b419-4acd6a5c5f78 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:02.737249 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3ac2d7ed-67ab-4d29-b419-4acd6a5c5f78 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:02.833661 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3ac2d7ed-67ab-4d29-b419-4acd6a5c5f78 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.111496 Oct 19 08:27:02.834359 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 305/606] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:02 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:27:02.840140 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-f260c024-2811-4de6-948d-027533c6905e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:02.841158 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-f260c024-2811-4de6-948d-027533c6905e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:02.848277 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f260c024-2811-4de6-948d-027533c6905e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:02.848716 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f260c024-2811-4de6-948d-027533c6905e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:02.849489 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f260c024-2811-4de6-948d-027533c6905e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:02.849913 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f260c024-2811-4de6-948d-027533c6905e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:02.926798 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-f260c024-2811-4de6-948d-027533c6905e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.090713 Oct 19 08:27:02.930729 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 306/607] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:02 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:27:03.163741 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-eeb73697-0bb8-460e-bef3-6680d63b94ea tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:03.173058 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-eeb73697-0bb8-460e-bef3-6680d63b94ea tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6" status: 200 len: 1317 microversion: 2.1 time: 0.493364 Oct 19 08:27:03.173884 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 302/608] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:02 2021] GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6 => generated 1317 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:03.286353 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-7ef8c266-f2d9-467f-a699-18bf4a96cbd6 req-484b33f2-9854-4e96-99e1-d992353b5829 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fefb359-52da-4d34-bb64-0201467132b6", "tag": "4d7c1ec2-ee4e-49ac-9c22-383e5a58b567"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:03.287834 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:27:03.287834 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:27:03.295677 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-7ef8c266-f2d9-467f-a699-18bf4a96cbd6 req-484b33f2-9854-4e96-99e1-d992353b5829 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:03.295932 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-95db588b-55ee-4d44-b53f-7ef5311e0ac0 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:03.296116 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-7ef8c266-f2d9-467f-a699-18bf4a96cbd6 req-484b33f2-9854-4e96-99e1-d992353b5829 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:03.296581 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-95db588b-55ee-4d44-b53f-7ef5311e0ac0 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:03.302881 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-95db588b-55ee-4d44-b53f-7ef5311e0ac0 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:03.303324 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-95db588b-55ee-4d44-b53f-7ef5311e0ac0 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:03.304103 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-95db588b-55ee-4d44-b53f-7ef5311e0ac0 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:03.304509 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-95db588b-55ee-4d44-b53f-7ef5311e0ac0 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:03.307125 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-7ef8c266-f2d9-467f-a699-18bf4a96cbd6 req-484b33f2-9854-4e96-99e1-d992353b5829 service nova] Creating event network-changed:4d7c1ec2-ee4e-49ac-9c22-383e5a58b567 for instance 5fefb359-52da-4d34-bb64-0201467132b6 on hv-cinder-81398 Oct 19 08:27:03.312498 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-7ef8c266-f2d9-467f-a699-18bf4a96cbd6 req-484b33f2-9854-4e96-99e1-d992353b5829 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030139 Oct 19 08:27:03.313394 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 307/609] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:27:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:27:03.428834 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-95db588b-55ee-4d44-b53f-7ef5311e0ac0 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:03.436819 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-95db588b-55ee-4d44-b53f-7ef5311e0ac0 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1521 microversion: 2.1 time: 0.145711 Oct 19 08:27:03.437366 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 303/610] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:03 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:27:03.846694 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-6a60ac76-a939-4039-8a9a-b83187d8c75d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:03.847785 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-6a60ac76-a939-4039-8a9a-b83187d8c75d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:03.854707 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6a60ac76-a939-4039-8a9a-b83187d8c75d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:03.855226 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6a60ac76-a939-4039-8a9a-b83187d8c75d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:03.856181 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6a60ac76-a939-4039-8a9a-b83187d8c75d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:03.856938 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6a60ac76-a939-4039-8a9a-b83187d8c75d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:03.938950 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-38477356-fbf8-4741-8950-c907e178731d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:03.939767 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-38477356-fbf8-4741-8950-c907e178731d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:03.945470 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-38477356-fbf8-4741-8950-c907e178731d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:03.945915 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-38477356-fbf8-4741-8950-c907e178731d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:03.946714 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-38477356-fbf8-4741-8950-c907e178731d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:03.947145 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-38477356-fbf8-4741-8950-c907e178731d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:03.959499 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-6a60ac76-a939-4039-8a9a-b83187d8c75d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.117224 Oct 19 08:27:03.964199 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 308/611] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:03 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:27:04.094044 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-38477356-fbf8-4741-8950-c907e178731d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.159190 Oct 19 08:27:04.098291 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 304/612] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:03 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:27:04.189869 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-62f6852e-9ff6-45ab-832e-3a9e132118f1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:04.190520 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-62f6852e-9ff6-45ab-832e-3a9e132118f1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:04.205540 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-62f6852e-9ff6-45ab-832e-3a9e132118f1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:04.205983 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-62f6852e-9ff6-45ab-832e-3a9e132118f1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:04.206782 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-62f6852e-9ff6-45ab-832e-3a9e132118f1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:04.207212 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-62f6852e-9ff6-45ab-832e-3a9e132118f1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:04.421929 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-62f6852e-9ff6-45ab-832e-3a9e132118f1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:04.430399 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-62f6852e-9ff6-45ab-832e-3a9e132118f1 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6" status: 200 len: 1317 microversion: 2.1 time: 0.244710 Oct 19 08:27:04.431227 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 309/613] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:04 2021] GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:04.454056 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-214dbce3-a295-473a-b3bc-a2a25092880b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:04.454709 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-214dbce3-a295-473a-b3bc-a2a25092880b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:04.461038 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-214dbce3-a295-473a-b3bc-a2a25092880b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:04.461552 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-214dbce3-a295-473a-b3bc-a2a25092880b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:04.462320 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-214dbce3-a295-473a-b3bc-a2a25092880b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:04.462785 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-214dbce3-a295-473a-b3bc-a2a25092880b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:04.591944 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-214dbce3-a295-473a-b3bc-a2a25092880b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:04.599611 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-214dbce3-a295-473a-b3bc-a2a25092880b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1521 microversion: 2.1 time: 0.150293 Oct 19 08:27:04.600202 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 305/614] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:04 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:04.971303 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-61c1bf3b-b4ed-4e81-94ac-0451603b3fe9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:04.972998 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-61c1bf3b-b4ed-4e81-94ac-0451603b3fe9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:04.978846 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-61c1bf3b-b4ed-4e81-94ac-0451603b3fe9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:04.979362 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-61c1bf3b-b4ed-4e81-94ac-0451603b3fe9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:04.980195 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-61c1bf3b-b4ed-4e81-94ac-0451603b3fe9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:04.980692 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-61c1bf3b-b4ed-4e81-94ac-0451603b3fe9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:05.067845 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-61c1bf3b-b4ed-4e81-94ac-0451603b3fe9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.100044 Oct 19 08:27:05.071824 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 310/615] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:04 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:27:05.108736 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-88fdb739-2936-4224-9b93-fe31a1668127 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:05.108736 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-88fdb739-2936-4224-9b93-fe31a1668127 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:05.113309 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-88fdb739-2936-4224-9b93-fe31a1668127 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:05.113759 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-88fdb739-2936-4224-9b93-fe31a1668127 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:05.114626 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-88fdb739-2936-4224-9b93-fe31a1668127 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:05.115065 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-88fdb739-2936-4224-9b93-fe31a1668127 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:05.201331 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-88fdb739-2936-4224-9b93-fe31a1668127 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.098285 Oct 19 08:27:05.202260 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 306/616] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:05 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:27:05.448313 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-04d9b6c2-a3b2-4ae5-b2a8-ce58b79154f3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:05.449035 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-04d9b6c2-a3b2-4ae5-b2a8-ce58b79154f3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:05.456180 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-04d9b6c2-a3b2-4ae5-b2a8-ce58b79154f3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:05.456622 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-04d9b6c2-a3b2-4ae5-b2a8-ce58b79154f3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:05.457582 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-04d9b6c2-a3b2-4ae5-b2a8-ce58b79154f3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:05.458013 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-04d9b6c2-a3b2-4ae5-b2a8-ce58b79154f3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:05.588389 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-04d9b6c2-a3b2-4ae5-b2a8-ce58b79154f3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:05.595624 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-04d9b6c2-a3b2-4ae5-b2a8-ce58b79154f3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6" status: 200 len: 1317 microversion: 2.1 time: 0.151231 Oct 19 08:27:05.596178 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 311/617] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:05 2021] GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:05.616355 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-1f2ca8c6-8218-4067-a28b-e13f55d8d413 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:05.617042 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-1f2ca8c6-8218-4067-a28b-e13f55d8d413 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:05.624090 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1f2ca8c6-8218-4067-a28b-e13f55d8d413 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:05.624519 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1f2ca8c6-8218-4067-a28b-e13f55d8d413 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:05.625285 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1f2ca8c6-8218-4067-a28b-e13f55d8d413 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:05.625712 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1f2ca8c6-8218-4067-a28b-e13f55d8d413 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:05.752341 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-1f2ca8c6-8218-4067-a28b-e13f55d8d413 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:05.759841 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-1f2ca8c6-8218-4067-a28b-e13f55d8d413 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1501 microversion: 2.1 time: 0.147557 Oct 19 08:27:05.760390 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 307/618] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:05 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1501 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:05.776203 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-4152a363-1445-4bc4-a0ef-f9178ec0ab88 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "054e05b8-d4a8-4fd1-9528-a669488ba745"}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:05.777265 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-4152a363-1445-4bc4-a0ef-f9178ec0ab88 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:05.783281 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4152a363-1445-4bc4-a0ef-f9178ec0ab88 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:05.783728 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4152a363-1445-4bc4-a0ef-f9178ec0ab88 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:05.784485 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4152a363-1445-4bc4-a0ef-f9178ec0ab88 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:05.784940 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4152a363-1445-4bc4-a0ef-f9178ec0ab88 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:05.809405 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.wsgi [None req-4152a363-1445-4bc4-a0ef-f9178ec0ab88 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] HTTP exception thrown: Cannot 'attach_volume' instance a2a856f6-f552-461f-8d9c-4bf017cbbac5 while it is in vm_state rescued Oct 19 08:27:05.810717 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-4152a363-1445-4bc4-a0ef-f9178ec0ab88 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Returning 409 to user: Cannot 'attach_volume' instance a2a856f6-f552-461f-8d9c-4bf017cbbac5 while it is in vm_state rescued {{(pid=114106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:27:05.811573 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-4152a363-1445-4bc4-a0ef-f9178ec0ab88 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "POST /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.039150 Oct 19 08:27:05.812284 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 312/619] 10.222.0.26 () {60 vars in 1322 bytes} [Tue Oct 19 08:27:05 2021] POST /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5/os-volume_attachments => generated 152 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 08:27:05.821068 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-f5ae151c-76ca-49dd-8ac0-463977b345a7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:05.821604 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-f5ae151c-76ca-49dd-8ac0-463977b345a7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:05.827652 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f5ae151c-76ca-49dd-8ac0-463977b345a7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:05.828094 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f5ae151c-76ca-49dd-8ac0-463977b345a7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:05.828867 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f5ae151c-76ca-49dd-8ac0-463977b345a7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:05.829297 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f5ae151c-76ca-49dd-8ac0-463977b345a7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:05.895954 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-f5ae151c-76ca-49dd-8ac0-463977b345a7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "POST /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5/action" status: 202 len: 0 microversion: 2.1 time: 0.078785 Oct 19 08:27:05.899698 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 308/620] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:05 2021] POST /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:27:05.905068 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c39c23e1-81a0-4d17-bc33-36efa54955f2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:05.905671 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c39c23e1-81a0-4d17-bc33-36efa54955f2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:05.911892 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c39c23e1-81a0-4d17-bc33-36efa54955f2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:05.912022 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c39c23e1-81a0-4d17-bc33-36efa54955f2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:05.912987 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c39c23e1-81a0-4d17-bc33-36efa54955f2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:05.913602 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c39c23e1-81a0-4d17-bc33-36efa54955f2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:06.080618 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-10b4e5fa-95d1-4050-8535-24b2b452ff69 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:06.081935 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-10b4e5fa-95d1-4050-8535-24b2b452ff69 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:06.091299 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-10b4e5fa-95d1-4050-8535-24b2b452ff69 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:06.091797 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-10b4e5fa-95d1-4050-8535-24b2b452ff69 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:06.092717 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-10b4e5fa-95d1-4050-8535-24b2b452ff69 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:06.093225 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-10b4e5fa-95d1-4050-8535-24b2b452ff69 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:06.123165 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-c39c23e1-81a0-4d17-bc33-36efa54955f2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:06.131871 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c39c23e1-81a0-4d17-bc33-36efa54955f2 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1509 microversion: 2.1 time: 0.230789 Oct 19 08:27:06.132448 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 313/621] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:05 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1509 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:06.214268 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3167a39d-10bc-4960-9d7c-748e38fc7316 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:06.215898 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3167a39d-10bc-4960-9d7c-748e38fc7316 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:06.223579 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3167a39d-10bc-4960-9d7c-748e38fc7316 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:06.224348 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3167a39d-10bc-4960-9d7c-748e38fc7316 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:06.225458 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3167a39d-10bc-4960-9d7c-748e38fc7316 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:06.225870 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3167a39d-10bc-4960-9d7c-748e38fc7316 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:06.228317 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-10b4e5fa-95d1-4050-8535-24b2b452ff69 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.151550 Oct 19 08:27:06.229579 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 309/622] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:06 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:27:06.444259 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3167a39d-10bc-4960-9d7c-748e38fc7316 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.234889 Oct 19 08:27:06.444942 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 314/623] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:06 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:27:06.613073 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-aa5c319c-1d4e-408d-883c-d6bdbb644335 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:06.613756 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-aa5c319c-1d4e-408d-883c-d6bdbb644335 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:06.620192 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-aa5c319c-1d4e-408d-883c-d6bdbb644335 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:06.620632 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-aa5c319c-1d4e-408d-883c-d6bdbb644335 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:06.621383 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-aa5c319c-1d4e-408d-883c-d6bdbb644335 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:06.621809 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-aa5c319c-1d4e-408d-883c-d6bdbb644335 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:06.740410 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-aa5c319c-1d4e-408d-883c-d6bdbb644335 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:06.748259 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-aa5c319c-1d4e-408d-883c-d6bdbb644335 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6" status: 200 len: 1317 microversion: 2.1 time: 0.139270 Oct 19 08:27:06.748874 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 310/624] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:06 2021] GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6 => generated 1317 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:07.150831 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-4ccd499c-9ec3-4462-820b-481248efab35 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:07.151434 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-4ccd499c-9ec3-4462-820b-481248efab35 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:07.157781 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4ccd499c-9ec3-4462-820b-481248efab35 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:07.158229 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4ccd499c-9ec3-4462-820b-481248efab35 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:07.159007 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4ccd499c-9ec3-4462-820b-481248efab35 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:07.159434 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4ccd499c-9ec3-4462-820b-481248efab35 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:07.241101 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d021ebe6-1527-4ef4-86d1-2e1208566882 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:07.242014 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-d021ebe6-1527-4ef4-86d1-2e1208566882 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:07.248514 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d021ebe6-1527-4ef4-86d1-2e1208566882 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:07.248955 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d021ebe6-1527-4ef4-86d1-2e1208566882 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:07.249720 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d021ebe6-1527-4ef4-86d1-2e1208566882 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:07.250149 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d021ebe6-1527-4ef4-86d1-2e1208566882 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:07.278834 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-4ccd499c-9ec3-4462-820b-481248efab35 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:07.286158 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-4ccd499c-9ec3-4462-820b-481248efab35 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1509 microversion: 2.1 time: 0.139464 Oct 19 08:27:07.286737 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 315/625] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:07 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1509 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:07.402000 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-d021ebe6-1527-4ef4-86d1-2e1208566882 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.164236 Oct 19 08:27:07.403037 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 311/626] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:07 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:27:07.456242 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-0b21691f-57cc-4a21-837b-d10f26d36bf3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:07.457145 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-0b21691f-57cc-4a21-837b-d10f26d36bf3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:07.462826 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0b21691f-57cc-4a21-837b-d10f26d36bf3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:07.463272 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0b21691f-57cc-4a21-837b-d10f26d36bf3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:07.464029 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0b21691f-57cc-4a21-837b-d10f26d36bf3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:07.464457 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0b21691f-57cc-4a21-837b-d10f26d36bf3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:07.646074 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-0b21691f-57cc-4a21-837b-d10f26d36bf3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.193392 Oct 19 08:27:07.646857 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 316/627] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:07 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:27:07.766414 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c0c8ab6e-70b2-4760-8e25-1a88dba5e8c5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:07.767053 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-c0c8ab6e-70b2-4760-8e25-1a88dba5e8c5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:07.773452 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c0c8ab6e-70b2-4760-8e25-1a88dba5e8c5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:07.773898 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c0c8ab6e-70b2-4760-8e25-1a88dba5e8c5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:07.774691 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c0c8ab6e-70b2-4760-8e25-1a88dba5e8c5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:07.775125 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c0c8ab6e-70b2-4760-8e25-1a88dba5e8c5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:07.897216 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-c0c8ab6e-70b2-4760-8e25-1a88dba5e8c5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:07.905092 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-c0c8ab6e-70b2-4760-8e25-1a88dba5e8c5 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6" status: 200 len: 1317 microversion: 2.1 time: 0.143343 Oct 19 08:27:07.905662 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 312/628] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:07 2021] GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6 => generated 1317 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:08.304013 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-5ea721e4-9c55-4f92-a085-d92a8b387bb9 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:08.304710 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-5ea721e4-9c55-4f92-a085-d92a8b387bb9 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:08.311474 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5ea721e4-9c55-4f92-a085-d92a8b387bb9 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:08.311905 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5ea721e4-9c55-4f92-a085-d92a8b387bb9 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:08.312648 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5ea721e4-9c55-4f92-a085-d92a8b387bb9 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:08.313066 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5ea721e4-9c55-4f92-a085-d92a8b387bb9 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:08.413398 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-55fe5e8f-1ed7-49a6-814e-1410199382db tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:08.415215 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-55fe5e8f-1ed7-49a6-814e-1410199382db tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:08.422059 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-55fe5e8f-1ed7-49a6-814e-1410199382db tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:08.422536 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-55fe5e8f-1ed7-49a6-814e-1410199382db tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:08.424778 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-55fe5e8f-1ed7-49a6-814e-1410199382db tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:08.425216 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-55fe5e8f-1ed7-49a6-814e-1410199382db tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:08.442164 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-5ea721e4-9c55-4f92-a085-d92a8b387bb9 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:08.452922 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-5ea721e4-9c55-4f92-a085-d92a8b387bb9 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1509 microversion: 2.1 time: 0.152805 Oct 19 08:27:08.458532 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 317/629] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:08 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:27:08.509979 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-55fe5e8f-1ed7-49a6-814e-1410199382db tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.100341 Oct 19 08:27:08.510801 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 313/630] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:08 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:27:08.658179 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-20b64126-a020-4ce3-9703-fc89754a920c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:08.659196 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-20b64126-a020-4ce3-9703-fc89754a920c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:08.664840 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-20b64126-a020-4ce3-9703-fc89754a920c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:08.665363 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-20b64126-a020-4ce3-9703-fc89754a920c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:08.666180 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-20b64126-a020-4ce3-9703-fc89754a920c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:08.666707 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-20b64126-a020-4ce3-9703-fc89754a920c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:08.922745 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-a090de06-1f02-460d-8176-3237aa9b206e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:08.923904 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-a090de06-1f02-460d-8176-3237aa9b206e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:08.925891 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-20b64126-a020-4ce3-9703-fc89754a920c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.271171 Oct 19 08:27:08.926549 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 318/631] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:08 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:27:08.930721 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a090de06-1f02-460d-8176-3237aa9b206e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:08.931321 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a090de06-1f02-460d-8176-3237aa9b206e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:08.932096 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a090de06-1f02-460d-8176-3237aa9b206e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:08.932527 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a090de06-1f02-460d-8176-3237aa9b206e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:09.065673 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-a090de06-1f02-460d-8176-3237aa9b206e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:09.072882 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-a090de06-1f02-460d-8176-3237aa9b206e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6" status: 200 len: 1317 microversion: 2.1 time: 0.154432 Oct 19 08:27:09.073444 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 314/632] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:08 2021] GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:27:09.471066 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3f131d1b-eeec-4039-a7d3-b00a304c0604 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:09.471831 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3f131d1b-eeec-4039-a7d3-b00a304c0604 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:09.478408 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3f131d1b-eeec-4039-a7d3-b00a304c0604 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:09.478877 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3f131d1b-eeec-4039-a7d3-b00a304c0604 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:09.479639 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3f131d1b-eeec-4039-a7d3-b00a304c0604 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:09.480068 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3f131d1b-eeec-4039-a7d3-b00a304c0604 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:09.521160 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-cb0b348c-0963-44a1-b72f-a083e16a22b2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:09.522098 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-cb0b348c-0963-44a1-b72f-a083e16a22b2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:09.527843 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cb0b348c-0963-44a1-b72f-a083e16a22b2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:09.528286 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cb0b348c-0963-44a1-b72f-a083e16a22b2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:09.529665 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cb0b348c-0963-44a1-b72f-a083e16a22b2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:09.530088 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cb0b348c-0963-44a1-b72f-a083e16a22b2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:09.603197 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3f131d1b-eeec-4039-a7d3-b00a304c0604 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:09.608938 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-cb0b348c-0963-44a1-b72f-a083e16a22b2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.091148 Oct 19 08:27:09.611838 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 315/633] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:09 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:27:09.611989 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3f131d1b-eeec-4039-a7d3-b00a304c0604 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1509 microversion: 2.1 time: 0.143735 Oct 19 08:27:09.611989 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 319/634] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:09 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1509 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:27:09.938928 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-714d11ec-7cb1-4f5f-8603-a2d9e2093032 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:09.939921 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-714d11ec-7cb1-4f5f-8603-a2d9e2093032 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:09.946293 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-714d11ec-7cb1-4f5f-8603-a2d9e2093032 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:09.946760 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-714d11ec-7cb1-4f5f-8603-a2d9e2093032 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:09.947516 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-714d11ec-7cb1-4f5f-8603-a2d9e2093032 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:09.947946 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-714d11ec-7cb1-4f5f-8603-a2d9e2093032 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:10.045083 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-714d11ec-7cb1-4f5f-8603-a2d9e2093032 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.110235 Oct 19 08:27:10.045705 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 316/635] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:09 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:27:10.090253 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-0d18ef44-1ae8-41fa-938e-32e38cf449e7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:10.090883 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-0d18ef44-1ae8-41fa-938e-32e38cf449e7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:10.096524 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0d18ef44-1ae8-41fa-938e-32e38cf449e7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:10.096967 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0d18ef44-1ae8-41fa-938e-32e38cf449e7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:10.097722 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0d18ef44-1ae8-41fa-938e-32e38cf449e7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:10.098150 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0d18ef44-1ae8-41fa-938e-32e38cf449e7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:10.216828 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-0d18ef44-1ae8-41fa-938e-32e38cf449e7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:10.224133 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-0d18ef44-1ae8-41fa-938e-32e38cf449e7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6" status: 200 len: 1317 microversion: 2.1 time: 0.137482 Oct 19 08:27:10.224781 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 320/636] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:10 2021] GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6 => generated 1317 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:10.621191 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-88ca97f4-c2df-492d-b558-e3058af64458 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:10.622213 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-88ca97f4-c2df-492d-b558-e3058af64458 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:10.627119 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-377326e7-ddb6-4716-b7a1-62ab74e4b7ba tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:10.627982 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-377326e7-ddb6-4716-b7a1-62ab74e4b7ba tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:10.628821 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-88ca97f4-c2df-492d-b558-e3058af64458 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:10.629269 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-88ca97f4-c2df-492d-b558-e3058af64458 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:10.630072 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-88ca97f4-c2df-492d-b558-e3058af64458 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:10.630796 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-88ca97f4-c2df-492d-b558-e3058af64458 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:10.635061 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-377326e7-ddb6-4716-b7a1-62ab74e4b7ba tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:10.635805 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-377326e7-ddb6-4716-b7a1-62ab74e4b7ba tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:10.636752 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-377326e7-ddb6-4716-b7a1-62ab74e4b7ba tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:10.637274 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-377326e7-ddb6-4716-b7a1-62ab74e4b7ba tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:10.724096 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-88ca97f4-c2df-492d-b558-e3058af64458 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.106924 Oct 19 08:27:10.727911 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 317/637] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:10 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:27:10.757281 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-377326e7-ddb6-4716-b7a1-62ab74e4b7ba tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:10.765145 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-377326e7-ddb6-4716-b7a1-62ab74e4b7ba tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1509 microversion: 2.1 time: 0.141583 Oct 19 08:27:10.765722 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 321/638] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:10 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1509 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:11.057241 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-24790d3e-4d77-4792-95c0-6758ee7197e4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:11.058693 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-24790d3e-4d77-4792-95c0-6758ee7197e4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:11.066073 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-24790d3e-4d77-4792-95c0-6758ee7197e4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:11.066695 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-24790d3e-4d77-4792-95c0-6758ee7197e4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:11.067555 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-24790d3e-4d77-4792-95c0-6758ee7197e4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:11.068189 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-24790d3e-4d77-4792-95c0-6758ee7197e4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:11.143681 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-24790d3e-4d77-4792-95c0-6758ee7197e4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.090516 Oct 19 08:27:11.144333 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 318/639] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:11 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:27:11.240580 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-2b428538-f2bb-4f94-9cd7-e882d35a56bc tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:11.241173 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-2b428538-f2bb-4f94-9cd7-e882d35a56bc tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:11.247623 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2b428538-f2bb-4f94-9cd7-e882d35a56bc tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:11.248162 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2b428538-f2bb-4f94-9cd7-e882d35a56bc tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:11.248951 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2b428538-f2bb-4f94-9cd7-e882d35a56bc tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:11.249378 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2b428538-f2bb-4f94-9cd7-e882d35a56bc tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:11.379911 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-2b428538-f2bb-4f94-9cd7-e882d35a56bc tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:11.387289 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-2b428538-f2bb-4f94-9cd7-e882d35a56bc tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6" status: 200 len: 1317 microversion: 2.1 time: 0.150447 Oct 19 08:27:11.387860 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 322/640] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:11 2021] GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:11.735923 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-05f55667-3762-4b37-948e-d626781d57c3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:11.736931 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-05f55667-3762-4b37-948e-d626781d57c3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:11.743327 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-05f55667-3762-4b37-948e-d626781d57c3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:11.743769 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-05f55667-3762-4b37-948e-d626781d57c3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:11.744524 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-05f55667-3762-4b37-948e-d626781d57c3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:11.744951 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-05f55667-3762-4b37-948e-d626781d57c3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:11.782366 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a12b037f-e7a2-4113-b071-35dd287adf6b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:11.783006 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a12b037f-e7a2-4113-b071-35dd287adf6b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:11.788672 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a12b037f-e7a2-4113-b071-35dd287adf6b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:11.789052 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a12b037f-e7a2-4113-b071-35dd287adf6b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:11.789797 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a12b037f-e7a2-4113-b071-35dd287adf6b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:11.790218 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a12b037f-e7a2-4113-b071-35dd287adf6b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:11.842785 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-05f55667-3762-4b37-948e-d626781d57c3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.110509 Oct 19 08:27:11.846614 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 319/641] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:11 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:27:11.911906 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a12b037f-e7a2-4113-b071-35dd287adf6b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:11.919619 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a12b037f-e7a2-4113-b071-35dd287adf6b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1509 microversion: 2.1 time: 0.141739 Oct 19 08:27:11.920388 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 323/642] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:11 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1509 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:27:12.156045 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-42cf452e-2e10-4ec4-8d29-ae0e251fa249 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:12.157035 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-42cf452e-2e10-4ec4-8d29-ae0e251fa249 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:12.163395 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-42cf452e-2e10-4ec4-8d29-ae0e251fa249 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:12.163839 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-42cf452e-2e10-4ec4-8d29-ae0e251fa249 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:12.164595 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-42cf452e-2e10-4ec4-8d29-ae0e251fa249 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:12.165022 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-42cf452e-2e10-4ec4-8d29-ae0e251fa249 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:12.266866 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-42cf452e-2e10-4ec4-8d29-ae0e251fa249 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.114863 Oct 19 08:27:12.267477 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 320/643] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:12 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:27:12.403786 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c0e99834-6f23-48a0-91a6-0917b379191b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:12.404376 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c0e99834-6f23-48a0-91a6-0917b379191b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:12.410228 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c0e99834-6f23-48a0-91a6-0917b379191b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:12.410642 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c0e99834-6f23-48a0-91a6-0917b379191b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:12.411389 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c0e99834-6f23-48a0-91a6-0917b379191b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:12.411808 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c0e99834-6f23-48a0-91a6-0917b379191b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:12.528073 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-c0e99834-6f23-48a0-91a6-0917b379191b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:12.535169 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c0e99834-6f23-48a0-91a6-0917b379191b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6" status: 200 len: 1317 microversion: 2.1 time: 0.135062 Oct 19 08:27:12.535716 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 324/644] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:12 2021] GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6 => generated 1317 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:12.854511 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d1265a1b-495e-4fae-95d7-fdac1051a48e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:12.855516 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-d1265a1b-495e-4fae-95d7-fdac1051a48e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:12.862319 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d1265a1b-495e-4fae-95d7-fdac1051a48e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:12.862797 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d1265a1b-495e-4fae-95d7-fdac1051a48e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:12.863563 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d1265a1b-495e-4fae-95d7-fdac1051a48e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:12.863992 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d1265a1b-495e-4fae-95d7-fdac1051a48e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:12.936979 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-2c62ade0-a459-43ff-a616-b4b323acdd88 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:12.937597 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-2c62ade0-a459-43ff-a616-b4b323acdd88 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:12.943695 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2c62ade0-a459-43ff-a616-b4b323acdd88 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:12.944140 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2c62ade0-a459-43ff-a616-b4b323acdd88 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:12.944894 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2c62ade0-a459-43ff-a616-b4b323acdd88 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:12.945322 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2c62ade0-a459-43ff-a616-b4b323acdd88 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:13.039978 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-d1265a1b-495e-4fae-95d7-fdac1051a48e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.189219 Oct 19 08:27:13.044798 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 321/645] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:12 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:27:13.067882 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-2c62ade0-a459-43ff-a616-b4b323acdd88 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:13.075059 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-2c62ade0-a459-43ff-a616-b4b323acdd88 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1515 microversion: 2.1 time: 0.142326 Oct 19 08:27:13.075711 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 325/646] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:12 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1515 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:27:13.280874 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-499d7dfd-4145-4843-aa8b-a3d3549f659f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:13.280874 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-499d7dfd-4145-4843-aa8b-a3d3549f659f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:13.286960 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-499d7dfd-4145-4843-aa8b-a3d3549f659f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:13.287409 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-499d7dfd-4145-4843-aa8b-a3d3549f659f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:13.288203 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-499d7dfd-4145-4843-aa8b-a3d3549f659f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:13.288592 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-499d7dfd-4145-4843-aa8b-a3d3549f659f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:13.552310 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-8ce8e330-c0b3-42c6-b1aa-d70e210ee436 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:13.552840 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-8ce8e330-c0b3-42c6-b1aa-d70e210ee436 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:13.558480 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8ce8e330-c0b3-42c6-b1aa-d70e210ee436 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:13.558939 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8ce8e330-c0b3-42c6-b1aa-d70e210ee436 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:13.560271 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8ce8e330-c0b3-42c6-b1aa-d70e210ee436 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:13.561005 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8ce8e330-c0b3-42c6-b1aa-d70e210ee436 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:13.681719 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-8ce8e330-c0b3-42c6-b1aa-d70e210ee436 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:13.689508 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-8ce8e330-c0b3-42c6-b1aa-d70e210ee436 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6" status: 200 len: 1317 microversion: 2.1 time: 0.140931 Oct 19 08:27:13.690140 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 326/647] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:13 2021] GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6 => generated 1317 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:27:14.052269 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-42daf69d-827a-47ee-927d-4397b88f2f62 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:14.053171 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-42daf69d-827a-47ee-927d-4397b88f2f62 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:14.058936 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-42daf69d-827a-47ee-927d-4397b88f2f62 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:14.059376 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-42daf69d-827a-47ee-927d-4397b88f2f62 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:14.060742 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-42daf69d-827a-47ee-927d-4397b88f2f62 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:14.061164 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-42daf69d-827a-47ee-927d-4397b88f2f62 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:16.284307 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-499d7dfd-4145-4843-aa8b-a3d3549f659f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 3.009047 Oct 19 08:27:16.284890 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 322/648] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:13 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 3011 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:27:16.289792 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-6ae4d63e-14f2-469e-a247-ec7369c2ab91 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:16.290470 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-6ae4d63e-14f2-469e-a247-ec7369c2ab91 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:16.297488 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6ae4d63e-14f2-469e-a247-ec7369c2ab91 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:16.297927 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6ae4d63e-14f2-469e-a247-ec7369c2ab91 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:16.298721 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6ae4d63e-14f2-469e-a247-ec7369c2ab91 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:16.299151 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6ae4d63e-14f2-469e-a247-ec7369c2ab91 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:16.420040 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-6ae4d63e-14f2-469e-a247-ec7369c2ab91 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:16.427856 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-6ae4d63e-14f2-469e-a247-ec7369c2ab91 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6" status: 200 len: 1317 microversion: 2.1 time: 0.141721 Oct 19 08:27:16.428406 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 323/649] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:16 2021] GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6 => generated 1317 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:16.432747 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-deefda63-81c2-4470-8b72-4e4767178650 req-bcbcd9f5-02c9-464a-a916-be60bea2ae1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fefb359-52da-4d34-bb64-0201467132b6", "name": "network-vif-plugged", "status": "completed", "tag": "4d7c1ec2-ee4e-49ac-9c22-383e5a58b567"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:16.434355 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:27:16.434355 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:27:16.441605 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-deefda63-81c2-4470-8b72-4e4767178650 req-bcbcd9f5-02c9-464a-a916-be60bea2ae1a service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:16.442044 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-deefda63-81c2-4470-8b72-4e4767178650 req-bcbcd9f5-02c9-464a-a916-be60bea2ae1a service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:16.453100 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-deefda63-81c2-4470-8b72-4e4767178650 req-bcbcd9f5-02c9-464a-a916-be60bea2ae1a service nova] Creating event network-vif-plugged:4d7c1ec2-ee4e-49ac-9c22-383e5a58b567 for instance 5fefb359-52da-4d34-bb64-0201467132b6 on hv-cinder-81398 Oct 19 08:27:16.457792 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-deefda63-81c2-4470-8b72-4e4767178650 req-bcbcd9f5-02c9-464a-a916-be60bea2ae1a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028323 Oct 19 08:27:16.458425 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 324/650] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:27:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:27:17.296791 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-00b1c22f-b3e7-4772-9349-25ab0015b828 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:17.297780 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-00b1c22f-b3e7-4772-9349-25ab0015b828 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:17.303785 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-00b1c22f-b3e7-4772-9349-25ab0015b828 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:17.304226 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-00b1c22f-b3e7-4772-9349-25ab0015b828 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:17.304974 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-00b1c22f-b3e7-4772-9349-25ab0015b828 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:17.305408 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-00b1c22f-b3e7-4772-9349-25ab0015b828 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:17.962881 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-42daf69d-827a-47ee-927d-4397b88f2f62 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 3.913877 Oct 19 08:27:17.963575 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 327/651] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:14 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 3915 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:27:17.968822 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e3328201-e79b-41df-b9b5-cdc77e146cb7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:17.969505 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e3328201-e79b-41df-b9b5-cdc77e146cb7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:17.975498 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-00b1c22f-b3e7-4772-9349-25ab0015b828 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.683110 Oct 19 08:27:17.976040 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e3328201-e79b-41df-b9b5-cdc77e146cb7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:17.976500 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e3328201-e79b-41df-b9b5-cdc77e146cb7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:17.977263 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e3328201-e79b-41df-b9b5-cdc77e146cb7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:17.977794 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e3328201-e79b-41df-b9b5-cdc77e146cb7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:17.980047 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 325/652] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:17 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:27:18.140875 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-e3328201-e79b-41df-b9b5-cdc77e146cb7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:18.148705 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e3328201-e79b-41df-b9b5-cdc77e146cb7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6" status: 200 len: 1317 microversion: 2.1 time: 0.184075 Oct 19 08:27:18.149288 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 328/653] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:17 2021] GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:18.974227 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-f3e41f5b-4eb0-4d04-aca2-893bd0c6f6dd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:18.975226 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-f3e41f5b-4eb0-4d04-aca2-893bd0c6f6dd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:18.981532 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f3e41f5b-4eb0-4d04-aca2-893bd0c6f6dd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:18.981970 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f3e41f5b-4eb0-4d04-aca2-893bd0c6f6dd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:18.982816 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f3e41f5b-4eb0-4d04-aca2-893bd0c6f6dd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:18.983791 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f3e41f5b-4eb0-4d04-aca2-893bd0c6f6dd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:18.987791 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-4f4c4a48-ea58-4bfb-804c-7bdb8c71e9c2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:18.988695 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-4f4c4a48-ea58-4bfb-804c-7bdb8c71e9c2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:18.994726 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4f4c4a48-ea58-4bfb-804c-7bdb8c71e9c2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:18.995171 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4f4c4a48-ea58-4bfb-804c-7bdb8c71e9c2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:18.995925 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4f4c4a48-ea58-4bfb-804c-7bdb8c71e9c2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:18.996352 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4f4c4a48-ea58-4bfb-804c-7bdb8c71e9c2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:19.187586 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-f3e41f5b-4eb0-4d04-aca2-893bd0c6f6dd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.216389 Oct 19 08:27:19.191508 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 326/654] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:18 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:27:19.195207 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-ac77e5b9-988b-4b50-b0d9-cd9fbb2e41f3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:19.195880 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-ac77e5b9-988b-4b50-b0d9-cd9fbb2e41f3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:19.200862 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-4f4c4a48-ea58-4bfb-804c-7bdb8c71e9c2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.216685 Oct 19 08:27:19.202306 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 329/655] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:18 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:27:19.202419 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ac77e5b9-988b-4b50-b0d9-cd9fbb2e41f3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:19.202523 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ac77e5b9-988b-4b50-b0d9-cd9fbb2e41f3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:19.203252 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ac77e5b9-988b-4b50-b0d9-cd9fbb2e41f3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:19.203677 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ac77e5b9-988b-4b50-b0d9-cd9fbb2e41f3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:19.322308 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-ac77e5b9-988b-4b50-b0d9-cd9fbb2e41f3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:19.329373 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-ac77e5b9-988b-4b50-b0d9-cd9fbb2e41f3 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6" status: 200 len: 1317 microversion: 2.1 time: 0.139921 Oct 19 08:27:19.329920 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 327/656] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:19 2021] GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6 => generated 1317 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:19.630040 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-308710b8-4ab8-4bc6-90b5-bf3b8155050c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:19.631303 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-308710b8-4ab8-4bc6-90b5-bf3b8155050c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:19.639915 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-308710b8-4ab8-4bc6-90b5-bf3b8155050c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:19.640546 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-308710b8-4ab8-4bc6-90b5-bf3b8155050c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:19.641827 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-308710b8-4ab8-4bc6-90b5-bf3b8155050c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:19.642441 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-308710b8-4ab8-4bc6-90b5-bf3b8155050c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:19.767713 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-308710b8-4ab8-4bc6-90b5-bf3b8155050c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:19.774829 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-308710b8-4ab8-4bc6-90b5-bf3b8155050c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1515 microversion: 2.1 time: 0.153976 Oct 19 08:27:19.775398 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 330/657] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:19 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:19.791396 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-5ad016e7-67b6-4335-aa0c-73c6382af9a9 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2bdd5a60-577c-4198-832c-a98b07308b49"}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:19.792439 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-5ad016e7-67b6-4335-aa0c-73c6382af9a9 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:19.798116 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5ad016e7-67b6-4335-aa0c-73c6382af9a9 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:19.798591 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5ad016e7-67b6-4335-aa0c-73c6382af9a9 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:19.799345 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5ad016e7-67b6-4335-aa0c-73c6382af9a9 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:19.799774 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5ad016e7-67b6-4335-aa0c-73c6382af9a9 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:20.050714 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-5ad016e7-67b6-4335-aa0c-73c6382af9a9 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "POST /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262786 Oct 19 08:27:20.051342 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 328/658] 10.222.0.26 () {60 vars in 1322 bytes} [Tue Oct 19 08:27:19 2021] POST /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:27:20.198063 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-d49a8ef9-0f25-4e6e-8c7f-705ff2a11c6b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:20.199010 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-d49a8ef9-0f25-4e6e-8c7f-705ff2a11c6b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:20.205409 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d49a8ef9-0f25-4e6e-8c7f-705ff2a11c6b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:20.205848 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d49a8ef9-0f25-4e6e-8c7f-705ff2a11c6b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:20.206636 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d49a8ef9-0f25-4e6e-8c7f-705ff2a11c6b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:20.207068 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d49a8ef9-0f25-4e6e-8c7f-705ff2a11c6b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:20.213159 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-6b0836f9-24d4-47a0-9694-ed81c8b5eb2f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:20.214213 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-6b0836f9-24d4-47a0-9694-ed81c8b5eb2f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:20.220445 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b0836f9-24d4-47a0-9694-ed81c8b5eb2f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:20.221268 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b0836f9-24d4-47a0-9694-ed81c8b5eb2f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:20.221659 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b0836f9-24d4-47a0-9694-ed81c8b5eb2f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:20.222087 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b0836f9-24d4-47a0-9694-ed81c8b5eb2f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:23.811944 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-d49a8ef9-0f25-4e6e-8c7f-705ff2a11c6b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 3.616592 Oct 19 08:27:23.812851 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 331/659] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:20 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 3619 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:27:23.817780 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-33896e0c-781a-46fc-8256-f9b7388af577 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:23.818660 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-33896e0c-781a-46fc-8256-f9b7388af577 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:23.824948 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-33896e0c-781a-46fc-8256-f9b7388af577 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:23.825392 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-33896e0c-781a-46fc-8256-f9b7388af577 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:23.826145 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-33896e0c-781a-46fc-8256-f9b7388af577 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:23.826610 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-33896e0c-781a-46fc-8256-f9b7388af577 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:23.945230 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-33896e0c-781a-46fc-8256-f9b7388af577 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:23.952353 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-33896e0c-781a-46fc-8256-f9b7388af577 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6" status: 200 len: 1317 microversion: 2.1 time: 0.138195 Oct 19 08:27:23.952915 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 332/660] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:23 2021] GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6 => generated 1317 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:24.823448 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-70037ff2-99a0-4eb3-be8e-cba4db09ed7d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:24.824355 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-70037ff2-99a0-4eb3-be8e-cba4db09ed7d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:24.831096 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-70037ff2-99a0-4eb3-be8e-cba4db09ed7d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:24.831538 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-70037ff2-99a0-4eb3-be8e-cba4db09ed7d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:24.832294 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-70037ff2-99a0-4eb3-be8e-cba4db09ed7d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:24.832721 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-70037ff2-99a0-4eb3-be8e-cba4db09ed7d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:25.371322 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-6b0836f9-24d4-47a0-9694-ed81c8b5eb2f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 5.162109 Oct 19 08:27:25.372462 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 329/661] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:20 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 5164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:27:25.380195 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-50e67478-c22f-408b-8eda-4b62f93d3b6f tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:25.381137 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-50e67478-c22f-408b-8eda-4b62f93d3b6f tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:25.387062 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-50e67478-c22f-408b-8eda-4b62f93d3b6f tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:25.387502 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-50e67478-c22f-408b-8eda-4b62f93d3b6f tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:25.388253 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-50e67478-c22f-408b-8eda-4b62f93d3b6f tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:25.388768 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-50e67478-c22f-408b-8eda-4b62f93d3b6f tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:25.486904 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-70037ff2-99a0-4eb3-be8e-cba4db09ed7d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.666784 Oct 19 08:27:25.487930 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 333/662] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:24 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:27:25.517086 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-50e67478-c22f-408b-8eda-4b62f93d3b6f tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:25.524144 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-50e67478-c22f-408b-8eda-4b62f93d3b6f tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6" status: 200 len: 1317 microversion: 2.1 time: 0.150249 Oct 19 08:27:25.524835 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 330/663] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:25 2021] GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:26.384891 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-4b88b00b-ff18-4370-abbc-b1ba74cb19a5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:26.385872 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-4b88b00b-ff18-4370-abbc-b1ba74cb19a5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:26.393196 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4b88b00b-ff18-4370-abbc-b1ba74cb19a5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:26.393636 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4b88b00b-ff18-4370-abbc-b1ba74cb19a5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:26.394391 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4b88b00b-ff18-4370-abbc-b1ba74cb19a5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:26.394838 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4b88b00b-ff18-4370-abbc-b1ba74cb19a5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:26.498174 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-b3b86bc9-e169-4621-b3df-ff06488d12f1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:26.499185 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-b3b86bc9-e169-4621-b3df-ff06488d12f1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:26.506916 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b3b86bc9-e169-4621-b3df-ff06488d12f1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:26.507358 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b3b86bc9-e169-4621-b3df-ff06488d12f1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:26.508125 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-4b88b00b-ff18-4370-abbc-b1ba74cb19a5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.127171 Oct 19 08:27:26.508240 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b3b86bc9-e169-4621-b3df-ff06488d12f1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:26.508809 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b3b86bc9-e169-4621-b3df-ff06488d12f1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:26.508938 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 334/664] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:26 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:27:26.541145 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ff649fe2-78cc-4af8-99f3-e06d8e951009 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:26.541885 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ff649fe2-78cc-4af8-99f3-e06d8e951009 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:26.548814 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ff649fe2-78cc-4af8-99f3-e06d8e951009 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:26.549251 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ff649fe2-78cc-4af8-99f3-e06d8e951009 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:26.550005 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ff649fe2-78cc-4af8-99f3-e06d8e951009 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:26.550430 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ff649fe2-78cc-4af8-99f3-e06d8e951009 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:26.590784 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-b3b86bc9-e169-4621-b3df-ff06488d12f1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.095968 Oct 19 08:27:26.594825 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 331/665] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:26 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:27:26.675676 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ff649fe2-78cc-4af8-99f3-e06d8e951009 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:26.682963 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ff649fe2-78cc-4af8-99f3-e06d8e951009 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6" status: 200 len: 1508 microversion: 2.1 time: 0.145784 Oct 19 08:27:26.683519 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 335/666] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:26 2021] GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6 => generated 1508 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:27:27.521680 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d2467e0f-390d-46d2-b06f-c38e7ca78628 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:27.522724 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-d2467e0f-390d-46d2-b06f-c38e7ca78628 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:27.530012 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d2467e0f-390d-46d2-b06f-c38e7ca78628 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:27.530682 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d2467e0f-390d-46d2-b06f-c38e7ca78628 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:27.531710 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d2467e0f-390d-46d2-b06f-c38e7ca78628 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:27.532374 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d2467e0f-390d-46d2-b06f-c38e7ca78628 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:27.602230 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e505bdf7-8eeb-4ee1-be60-43479f7f0c54 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:27.602920 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-d2467e0f-390d-46d2-b06f-c38e7ca78628 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.084634 Oct 19 08:27:27.603346 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e505bdf7-8eeb-4ee1-be60-43479f7f0c54 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:27.607104 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 332/667] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:27 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:27:27.613324 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e505bdf7-8eeb-4ee1-be60-43479f7f0c54 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:27.613773 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e505bdf7-8eeb-4ee1-be60-43479f7f0c54 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:27.614567 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e505bdf7-8eeb-4ee1-be60-43479f7f0c54 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:27.614997 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e505bdf7-8eeb-4ee1-be60-43479f7f0c54 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:27.689674 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e505bdf7-8eeb-4ee1-be60-43479f7f0c54 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.091125 Oct 19 08:27:27.691297 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 336/668] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:27 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:27:27.992575 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-a41cc73e-cc75-4ee1-a57b-608c611c3fde tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "254e771e-43ea-4238-8666-cc0644faefb7"}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:27.994106 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-a41cc73e-cc75-4ee1-a57b-608c611c3fde tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:28.001273 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a41cc73e-cc75-4ee1-a57b-608c611c3fde tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:28.001721 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a41cc73e-cc75-4ee1-a57b-608c611c3fde tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:28.002507 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a41cc73e-cc75-4ee1-a57b-608c611c3fde tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:28.002941 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a41cc73e-cc75-4ee1-a57b-608c611c3fde tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:28.270971 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-a41cc73e-cc75-4ee1-a57b-608c611c3fde tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "POST /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283347 Oct 19 08:27:28.271556 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 333/669] 10.222.0.26 () {60 vars in 1322 bytes} [Tue Oct 19 08:27:27 2021] POST /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:27:28.616495 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-7e5f4c14-34ac-4198-9251-580f06f92e22 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:28.617473 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-7e5f4c14-34ac-4198-9251-580f06f92e22 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:28.623811 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7e5f4c14-34ac-4198-9251-580f06f92e22 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:28.624240 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7e5f4c14-34ac-4198-9251-580f06f92e22 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:28.625238 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7e5f4c14-34ac-4198-9251-580f06f92e22 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:28.625439 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7e5f4c14-34ac-4198-9251-580f06f92e22 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:28.703447 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-91da7f91-942a-480a-8b22-0117bd74c118 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:28.704953 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-91da7f91-942a-480a-8b22-0117bd74c118 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:28.711029 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-91da7f91-942a-480a-8b22-0117bd74c118 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:28.711566 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-91da7f91-942a-480a-8b22-0117bd74c118 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:28.712395 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-91da7f91-942a-480a-8b22-0117bd74c118 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:28.712825 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-91da7f91-942a-480a-8b22-0117bd74c118 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:31.855869 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 08:27:31.856431 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: Tue Oct 19 08:27:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action (ip 10.222.0.26) !!! Oct 19 08:27:34.881974 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-91da7f91-942a-480a-8b22-0117bd74c118 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 6.183110 Oct 19 08:27:34.882627 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 334/670] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:28 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 6185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:27:34.890463 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-7e5f4c14-34ac-4198-9251-580f06f92e22 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 6.278417 Oct 19 08:27:34.891154 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 337/671] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:28 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 6280 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:27:35.894743 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d46f9505-3347-4a13-a427-9fc3620dcab1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:35.895644 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-d46f9505-3347-4a13-a427-9fc3620dcab1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:35.902079 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d46f9505-3347-4a13-a427-9fc3620dcab1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:35.902542 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d46f9505-3347-4a13-a427-9fc3620dcab1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:35.903148 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-d60fdf77-e1af-4af6-b02b-1a95109affa0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:35.903571 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d46f9505-3347-4a13-a427-9fc3620dcab1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:35.903723 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d46f9505-3347-4a13-a427-9fc3620dcab1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:35.904240 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-d60fdf77-e1af-4af6-b02b-1a95109affa0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:35.911195 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d60fdf77-e1af-4af6-b02b-1a95109affa0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:35.911627 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d60fdf77-e1af-4af6-b02b-1a95109affa0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:35.912379 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d60fdf77-e1af-4af6-b02b-1a95109affa0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:35.912808 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d60fdf77-e1af-4af6-b02b-1a95109affa0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:35.920764 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 08:27:35.923832 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: Tue Oct 19 08:27:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action (ip 10.222.0.26) !!! Oct 19 08:27:36.095783 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-d46f9505-3347-4a13-a427-9fc3620dcab1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.205534 Oct 19 08:27:36.096649 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 335/672] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:35 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:27:36.101826 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-d60fdf77-e1af-4af6-b02b-1a95109affa0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.202724 Oct 19 08:27:36.102682 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 338/673] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:35 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:27:37.108729 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-9c97ed99-7539-4368-a6c8-20ed88d75968 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:37.109773 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-9c97ed99-7539-4368-a6c8-20ed88d75968 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:37.114023 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a014964f-b829-4366-b9ee-cbb043fa8869 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:37.115118 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a014964f-b829-4366-b9ee-cbb043fa8869 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:37.116993 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9c97ed99-7539-4368-a6c8-20ed88d75968 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:37.117434 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9c97ed99-7539-4368-a6c8-20ed88d75968 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:37.118256 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9c97ed99-7539-4368-a6c8-20ed88d75968 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:37.118920 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9c97ed99-7539-4368-a6c8-20ed88d75968 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:37.123560 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a014964f-b829-4366-b9ee-cbb043fa8869 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:37.124038 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a014964f-b829-4366-b9ee-cbb043fa8869 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:37.124806 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a014964f-b829-4366-b9ee-cbb043fa8869 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:37.125242 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a014964f-b829-4366-b9ee-cbb043fa8869 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:37.214375 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a014964f-b829-4366-b9ee-cbb043fa8869 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.104838 Oct 19 08:27:37.215257 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 339/674] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:37 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:27:37.223583 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-9c97ed99-7539-4368-a6c8-20ed88d75968 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.118729 Oct 19 08:27:37.224214 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 336/675] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:37 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:27:38.015513 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-7d316b70-b432-45d5-b666-f1171a3a334c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:38.016516 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-7d316b70-b432-45d5-b666-f1171a3a334c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:38.024353 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7d316b70-b432-45d5-b666-f1171a3a334c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:38.024797 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7d316b70-b432-45d5-b666-f1171a3a334c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:38.025575 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7d316b70-b432-45d5-b666-f1171a3a334c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:38.026001 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7d316b70-b432-45d5-b666-f1171a3a334c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:38.049882 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.objects.instance [None req-7d316b70-b432-45d5-b666-f1171a3a334c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lazy-loading 'flavor' on Instance uuid a2a856f6-f552-461f-8d9c-4bf017cbbac5 {{(pid=114106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 19 08:27:38.167853 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-7d316b70-b432-45d5-b666-f1171a3a334c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "POST /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5/action" status: 200 len: 32 microversion: 2.1 time: 0.156398 Oct 19 08:27:38.168502 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 340/676] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:38 2021] POST /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 08:27:38.178720 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-beeba847-e0f0-431e-84fc-1e93900292db tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:38.179421 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-beeba847-e0f0-431e-84fc-1e93900292db tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:38.186649 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-beeba847-e0f0-431e-84fc-1e93900292db tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:38.187228 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-beeba847-e0f0-431e-84fc-1e93900292db tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:38.188012 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-beeba847-e0f0-431e-84fc-1e93900292db tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:38.188487 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-beeba847-e0f0-431e-84fc-1e93900292db tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:38.225736 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-69ebf448-08c0-4436-b988-d21595b3fcd0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:38.226799 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-69ebf448-08c0-4436-b988-d21595b3fcd0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:38.232868 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-69ebf448-08c0-4436-b988-d21595b3fcd0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:38.233311 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-69ebf448-08c0-4436-b988-d21595b3fcd0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:38.234285 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-69ebf448-08c0-4436-b988-d21595b3fcd0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:38.234738 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-69ebf448-08c0-4436-b988-d21595b3fcd0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:38.337045 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-69ebf448-08c0-4436-b988-d21595b3fcd0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.115267 Oct 19 08:27:38.337726 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 341/677] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:38 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:27:38.342903 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-4362b484-5395-4611-b7ec-d93ea4b42de2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:38.343900 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-4362b484-5395-4611-b7ec-d93ea4b42de2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:38.350859 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4362b484-5395-4611-b7ec-d93ea4b42de2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:38.351302 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4362b484-5395-4611-b7ec-d93ea4b42de2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:38.352075 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4362b484-5395-4611-b7ec-d93ea4b42de2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:38.352498 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4362b484-5395-4611-b7ec-d93ea4b42de2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:38.431975 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-4362b484-5395-4611-b7ec-d93ea4b42de2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.092813 Oct 19 08:27:38.439156 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 342/678] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:38 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:27:38.595841 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-beeba847-e0f0-431e-84fc-1e93900292db tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:38.605536 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-beeba847-e0f0-431e-84fc-1e93900292db tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1567 microversion: 2.1 time: 0.431670 Oct 19 08:27:38.606127 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 337/679] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:38 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1567 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:39.349987 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b430a85e-9135-4733-a4bf-11179645f392 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:39.351535 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b430a85e-9135-4733-a4bf-11179645f392 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:39.357632 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b430a85e-9135-4733-a4bf-11179645f392 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:39.358075 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b430a85e-9135-4733-a4bf-11179645f392 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:39.358862 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b430a85e-9135-4733-a4bf-11179645f392 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:39.359306 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b430a85e-9135-4733-a4bf-11179645f392 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:39.443209 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-29090914-0b5d-468d-a1a5-aaae81a825d6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:39.444122 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-29090914-0b5d-468d-a1a5-aaae81a825d6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:39.450345 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-29090914-0b5d-468d-a1a5-aaae81a825d6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:39.450821 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-29090914-0b5d-468d-a1a5-aaae81a825d6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:39.451584 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-29090914-0b5d-468d-a1a5-aaae81a825d6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:39.452018 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-29090914-0b5d-468d-a1a5-aaae81a825d6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:39.457802 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b430a85e-9135-4733-a4bf-11179645f392 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.110906 Oct 19 08:27:39.462162 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 343/680] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:39 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:27:39.576235 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-29090914-0b5d-468d-a1a5-aaae81a825d6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.137036 Oct 19 08:27:39.580429 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 338/681] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:39 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:27:39.623352 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-fdab5586-2f42-43db-8337-cc8fbd25a5ab tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:39.624039 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-fdab5586-2f42-43db-8337-cc8fbd25a5ab tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:39.631307 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fdab5586-2f42-43db-8337-cc8fbd25a5ab tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:39.631761 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fdab5586-2f42-43db-8337-cc8fbd25a5ab tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:39.632509 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fdab5586-2f42-43db-8337-cc8fbd25a5ab tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:39.632933 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fdab5586-2f42-43db-8337-cc8fbd25a5ab tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:39.757559 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-fdab5586-2f42-43db-8337-cc8fbd25a5ab tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:39.765185 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-fdab5586-2f42-43db-8337-cc8fbd25a5ab tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1567 microversion: 2.1 time: 0.145800 Oct 19 08:27:39.765739 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 344/682] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:39 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:40.020651 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-6a127c0e-4e82-4e94-8c5b-636a659640eb tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:40.021219 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-6a127c0e-4e82-4e94-8c5b-636a659640eb tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: 61889472-0e20-46bc-94d3-c4c42883a5b4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:40.027657 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6a127c0e-4e82-4e94-8c5b-636a659640eb tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:40.028098 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6a127c0e-4e82-4e94-8c5b-636a659640eb tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:40.028848 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6a127c0e-4e82-4e94-8c5b-636a659640eb tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:40.029267 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6a127c0e-4e82-4e94-8c5b-636a659640eb tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:40.150707 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.objects.instance [None req-6a127c0e-4e82-4e94-8c5b-636a659640eb tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lazy-loading 'services' on Instance uuid 61889472-0e20-46bc-94d3-c4c42883a5b4 {{(pid=114105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 19 08:27:40.260776 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-6a127c0e-4e82-4e94-8c5b-636a659640eb tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "DELETE /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4/os-volume_attachments/996a18fa-a154-47f6-8f8b-724f574a7cbf" status: 202 len: 0 microversion: 2.1 time: 0.244669 Oct 19 08:27:40.261347 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 339/683] 10.222.0.26 () {58 vars in 1415 bytes} [Tue Oct 19 08:27:40 2021] DELETE /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4/os-volume_attachments/996a18fa-a154-47f6-8f8b-724f574a7cbf => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:27:40.469802 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-03b153ce-41d8-4d49-99b5-8aa27e6396c8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:40.470737 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-03b153ce-41d8-4d49-99b5-8aa27e6396c8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:40.476684 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-03b153ce-41d8-4d49-99b5-8aa27e6396c8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:40.477124 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-03b153ce-41d8-4d49-99b5-8aa27e6396c8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:40.478084 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-03b153ce-41d8-4d49-99b5-8aa27e6396c8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:40.478804 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-03b153ce-41d8-4d49-99b5-8aa27e6396c8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:40.590745 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d71707be-36d4-47a3-9366-f7b304760176 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:40.592235 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-d71707be-36d4-47a3-9366-f7b304760176 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:40.594000 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-03b153ce-41d8-4d49-99b5-8aa27e6396c8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.127765 Oct 19 08:27:40.594721 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 345/684] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:40 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:27:40.598375 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d71707be-36d4-47a3-9366-f7b304760176 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:40.598849 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d71707be-36d4-47a3-9366-f7b304760176 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:40.599608 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d71707be-36d4-47a3-9366-f7b304760176 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:40.600035 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d71707be-36d4-47a3-9366-f7b304760176 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:40.690082 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-d71707be-36d4-47a3-9366-f7b304760176 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.104418 Oct 19 08:27:40.690837 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 340/685] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:40 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:27:40.783482 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-10f80bfd-08e1-4e24-ae51-1ae1cdf398dc tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:40.784292 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-10f80bfd-08e1-4e24-ae51-1ae1cdf398dc tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:40.791816 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-10f80bfd-08e1-4e24-ae51-1ae1cdf398dc tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:40.792257 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-10f80bfd-08e1-4e24-ae51-1ae1cdf398dc tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:40.793020 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-10f80bfd-08e1-4e24-ae51-1ae1cdf398dc tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:40.793449 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-10f80bfd-08e1-4e24-ae51-1ae1cdf398dc tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:40.929407 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-10f80bfd-08e1-4e24-ae51-1ae1cdf398dc tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:40.937111 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-10f80bfd-08e1-4e24-ae51-1ae1cdf398dc tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1567 microversion: 2.1 time: 0.157805 Oct 19 08:27:40.937673 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 346/686] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:40 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:41.606146 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-9b8789f1-e919-4c92-9416-212e46f1a519 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:41.607163 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-9b8789f1-e919-4c92-9416-212e46f1a519 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:41.614396 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9b8789f1-e919-4c92-9416-212e46f1a519 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:41.614862 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9b8789f1-e919-4c92-9416-212e46f1a519 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:41.615631 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9b8789f1-e919-4c92-9416-212e46f1a519 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:41.616060 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9b8789f1-e919-4c92-9416-212e46f1a519 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:41.699550 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-9b8789f1-e919-4c92-9416-212e46f1a519 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.097233 Oct 19 08:27:41.701126 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 341/687] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:41 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:27:41.701615 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-1da1b51e-54d8-49ec-b0b7-7976dac076ec tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:41.702715 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-1da1b51e-54d8-49ec-b0b7-7976dac076ec tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:41.709395 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1da1b51e-54d8-49ec-b0b7-7976dac076ec tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:41.709839 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1da1b51e-54d8-49ec-b0b7-7976dac076ec tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:41.710729 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1da1b51e-54d8-49ec-b0b7-7976dac076ec tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:41.711066 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1da1b51e-54d8-49ec-b0b7-7976dac076ec tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:41.789345 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-1da1b51e-54d8-49ec-b0b7-7976dac076ec tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.091143 Oct 19 08:27:41.790185 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 347/688] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:41 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:27:41.961971 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c901588a-7b6f-48eb-b0d3-cbc17e15f4b7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:41.962686 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-c901588a-7b6f-48eb-b0d3-cbc17e15f4b7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:41.968987 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c901588a-7b6f-48eb-b0d3-cbc17e15f4b7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:41.969431 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c901588a-7b6f-48eb-b0d3-cbc17e15f4b7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:41.970196 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c901588a-7b6f-48eb-b0d3-cbc17e15f4b7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:41.970652 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c901588a-7b6f-48eb-b0d3-cbc17e15f4b7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:42.099568 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-c901588a-7b6f-48eb-b0d3-cbc17e15f4b7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:42.107305 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-c901588a-7b6f-48eb-b0d3-cbc17e15f4b7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1567 microversion: 2.1 time: 0.149174 Oct 19 08:27:42.107867 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 342/689] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:41 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:42.712745 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-d842854b-ddd5-4521-b111-aa5934920ff3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:42.713726 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-d842854b-ddd5-4521-b111-aa5934920ff3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:42.720879 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d842854b-ddd5-4521-b111-aa5934920ff3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:42.721327 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d842854b-ddd5-4521-b111-aa5934920ff3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:42.722663 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d842854b-ddd5-4521-b111-aa5934920ff3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:42.723167 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d842854b-ddd5-4521-b111-aa5934920ff3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:42.801047 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-a8e99fe7-d52e-4cc1-b000-08079515a71c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:42.801598 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-d842854b-ddd5-4521-b111-aa5934920ff3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.092525 Oct 19 08:27:42.801945 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-a8e99fe7-d52e-4cc1-b000-08079515a71c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:42.802047 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 348/690] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:42 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:27:42.808256 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a8e99fe7-d52e-4cc1-b000-08079515a71c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:42.808821 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a8e99fe7-d52e-4cc1-b000-08079515a71c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:42.809759 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a8e99fe7-d52e-4cc1-b000-08079515a71c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:42.810254 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a8e99fe7-d52e-4cc1-b000-08079515a71c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:42.906985 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-a8e99fe7-d52e-4cc1-b000-08079515a71c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.109418 Oct 19 08:27:42.907700 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 343/691] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:42 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:27:43.124772 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-356b3627-874f-41a1-bb20-75cdf20816bd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:43.125449 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-356b3627-874f-41a1-bb20-75cdf20816bd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:43.132336 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-356b3627-874f-41a1-bb20-75cdf20816bd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:43.132773 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-356b3627-874f-41a1-bb20-75cdf20816bd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:43.133525 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-356b3627-874f-41a1-bb20-75cdf20816bd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:43.133945 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-356b3627-874f-41a1-bb20-75cdf20816bd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:43.257889 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-356b3627-874f-41a1-bb20-75cdf20816bd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:43.265857 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-356b3627-874f-41a1-bb20-75cdf20816bd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1567 microversion: 2.1 time: 0.145084 Oct 19 08:27:43.266407 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 349/692] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:43 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1567 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:43.813427 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-68b2cb75-65cd-4eb8-aa3b-c487d90e0505 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:43.814333 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-68b2cb75-65cd-4eb8-aa3b-c487d90e0505 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:43.821391 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-68b2cb75-65cd-4eb8-aa3b-c487d90e0505 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:43.821834 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-68b2cb75-65cd-4eb8-aa3b-c487d90e0505 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:43.822629 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-68b2cb75-65cd-4eb8-aa3b-c487d90e0505 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:43.823058 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-68b2cb75-65cd-4eb8-aa3b-c487d90e0505 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:43.899176 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-68b2cb75-65cd-4eb8-aa3b-c487d90e0505 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.089630 Oct 19 08:27:43.899812 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 344/693] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:43 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:27:43.918898 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-7975e78d-3deb-4c87-9530-b433b9ac86ac tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:43.919802 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-7975e78d-3deb-4c87-9530-b433b9ac86ac tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:43.926140 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7975e78d-3deb-4c87-9530-b433b9ac86ac tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:43.926604 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7975e78d-3deb-4c87-9530-b433b9ac86ac tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:43.927360 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7975e78d-3deb-4c87-9530-b433b9ac86ac tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:43.927781 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7975e78d-3deb-4c87-9530-b433b9ac86ac tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:44.011011 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-7975e78d-3deb-4c87-9530-b433b9ac86ac tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.095503 Oct 19 08:27:44.011642 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 350/694] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:43 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:27:44.284272 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-e6d91bc1-baff-4f35-bbd5-10ab790eeb5c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:44.285060 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-e6d91bc1-baff-4f35-bbd5-10ab790eeb5c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:44.292107 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e6d91bc1-baff-4f35-bbd5-10ab790eeb5c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:44.292609 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e6d91bc1-baff-4f35-bbd5-10ab790eeb5c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:44.293599 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e6d91bc1-baff-4f35-bbd5-10ab790eeb5c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:44.294177 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e6d91bc1-baff-4f35-bbd5-10ab790eeb5c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:44.421009 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-e6d91bc1-baff-4f35-bbd5-10ab790eeb5c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:44.429537 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-e6d91bc1-baff-4f35-bbd5-10ab790eeb5c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1567 microversion: 2.1 time: 0.149510 Oct 19 08:27:44.430099 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 345/695] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:44 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:44.911870 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-553c322b-e109-4a02-b1ec-cc31a1465706 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:44.912874 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-553c322b-e109-4a02-b1ec-cc31a1465706 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:44.919156 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-553c322b-e109-4a02-b1ec-cc31a1465706 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:44.919713 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-553c322b-e109-4a02-b1ec-cc31a1465706 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:44.920352 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-553c322b-e109-4a02-b1ec-cc31a1465706 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:44.920755 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-553c322b-e109-4a02-b1ec-cc31a1465706 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:45.002626 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-553c322b-e109-4a02-b1ec-cc31a1465706 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.095050 Oct 19 08:27:45.004126 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 351/696] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:44 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:27:45.023044 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2602d753-a585-4214-810a-fabcbfe6a0ee tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:45.023968 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2602d753-a585-4214-810a-fabcbfe6a0ee tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:45.029606 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2602d753-a585-4214-810a-fabcbfe6a0ee tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:45.030065 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2602d753-a585-4214-810a-fabcbfe6a0ee tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:45.030853 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2602d753-a585-4214-810a-fabcbfe6a0ee tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:45.031290 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2602d753-a585-4214-810a-fabcbfe6a0ee tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:45.102164 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2602d753-a585-4214-810a-fabcbfe6a0ee tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.083238 Oct 19 08:27:45.102976 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 346/697] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:45 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:27:45.307897 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-6a276d9b-a982-4f5f-92ec-376c8b245ede tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:45.308462 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-6a276d9b-a982-4f5f-92ec-376c8b245ede tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:45.314840 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6a276d9b-a982-4f5f-92ec-376c8b245ede tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:45.315271 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6a276d9b-a982-4f5f-92ec-376c8b245ede tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:45.316638 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6a276d9b-a982-4f5f-92ec-376c8b245ede tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:45.317242 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6a276d9b-a982-4f5f-92ec-376c8b245ede tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:45.393148 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.objects.instance [None req-6a276d9b-a982-4f5f-92ec-376c8b245ede tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lazy-loading 'services' on Instance uuid 5fefb359-52da-4d34-bb64-0201467132b6 {{(pid=114106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 19 08:27:45.447761 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-68743684-1fec-4a0e-a967-c87fab2a7ac6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:45.448447 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-68743684-1fec-4a0e-a967-c87fab2a7ac6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:45.455301 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-68743684-1fec-4a0e-a967-c87fab2a7ac6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:45.455765 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-68743684-1fec-4a0e-a967-c87fab2a7ac6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:45.460983 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-68743684-1fec-4a0e-a967-c87fab2a7ac6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:45.461430 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-68743684-1fec-4a0e-a967-c87fab2a7ac6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:45.463372 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-6a276d9b-a982-4f5f-92ec-376c8b245ede tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6/os-volume_attachments/254e771e-43ea-4238-8666-cc0644faefb7" status: 202 len: 0 microversion: 2.1 time: 0.159284 Oct 19 08:27:45.466418 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 352/698] 10.222.0.26 () {58 vars in 1415 bytes} [Tue Oct 19 08:27:45 2021] DELETE /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6/os-volume_attachments/254e771e-43ea-4238-8666-cc0644faefb7 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:27:45.472343 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-0438fdf4-9a2e-49aa-92f7-2d2d71b39c03 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:45.473330 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-0438fdf4-9a2e-49aa-92f7-2d2d71b39c03 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:45.479320 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0438fdf4-9a2e-49aa-92f7-2d2d71b39c03 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:45.479763 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0438fdf4-9a2e-49aa-92f7-2d2d71b39c03 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:45.480665 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0438fdf4-9a2e-49aa-92f7-2d2d71b39c03 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:45.480949 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0438fdf4-9a2e-49aa-92f7-2d2d71b39c03 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:45.512115 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-0438fdf4-9a2e-49aa-92f7-2d2d71b39c03 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043711 Oct 19 08:27:45.512872 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 353/699] 10.222.0.26 () {58 vars in 1301 bytes} [Tue Oct 19 08:27:45 2021] GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 08:27:45.593489 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-68743684-1fec-4a0e-a967-c87fab2a7ac6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:45.601887 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-68743684-1fec-4a0e-a967-c87fab2a7ac6 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1567 microversion: 2.1 time: 0.158409 Oct 19 08:27:45.602443 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 347/700] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:45 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:46.014006 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-7e41de11-6b7c-4f63-9b53-10810cbe0375 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:46.014951 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-7e41de11-6b7c-4f63-9b53-10810cbe0375 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:46.021499 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7e41de11-6b7c-4f63-9b53-10810cbe0375 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:46.021945 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7e41de11-6b7c-4f63-9b53-10810cbe0375 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:46.022745 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7e41de11-6b7c-4f63-9b53-10810cbe0375 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:46.023206 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7e41de11-6b7c-4f63-9b53-10810cbe0375 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:46.113183 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-e3042c0b-6eaf-40d2-a7b1-e8026f871969 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:46.114115 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-e3042c0b-6eaf-40d2-a7b1-e8026f871969 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:46.119818 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e3042c0b-6eaf-40d2-a7b1-e8026f871969 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:46.120267 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e3042c0b-6eaf-40d2-a7b1-e8026f871969 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:46.121032 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e3042c0b-6eaf-40d2-a7b1-e8026f871969 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:46.121460 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e3042c0b-6eaf-40d2-a7b1-e8026f871969 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:46.159374 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-7e41de11-6b7c-4f63-9b53-10810cbe0375 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.148798 Oct 19 08:27:46.160402 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 354/701] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:46 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:27:46.204334 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-e3042c0b-6eaf-40d2-a7b1-e8026f871969 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.094995 Oct 19 08:27:46.204939 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 348/702] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:46 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:27:46.524614 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-02746003-e422-4b73-92d7-86e25bd5a75b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:46.525635 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-02746003-e422-4b73-92d7-86e25bd5a75b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:46.531901 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-02746003-e422-4b73-92d7-86e25bd5a75b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:46.532343 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-02746003-e422-4b73-92d7-86e25bd5a75b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:46.533097 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-02746003-e422-4b73-92d7-86e25bd5a75b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:46.533526 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-02746003-e422-4b73-92d7-86e25bd5a75b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:46.564506 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-02746003-e422-4b73-92d7-86e25bd5a75b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043869 Oct 19 08:27:46.565150 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 355/703] 10.222.0.26 () {58 vars in 1301 bytes} [Tue Oct 19 08:27:46 2021] GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:27:46.619334 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2fccb3e6-1e9c-4e27-a619-de620657c36a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:46.620245 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2fccb3e6-1e9c-4e27-a619-de620657c36a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:46.626864 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2fccb3e6-1e9c-4e27-a619-de620657c36a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:46.627374 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2fccb3e6-1e9c-4e27-a619-de620657c36a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:46.628721 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2fccb3e6-1e9c-4e27-a619-de620657c36a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:46.629227 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2fccb3e6-1e9c-4e27-a619-de620657c36a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:46.666921 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-9c7ad79e-151c-4865-a63f-a080562b6b9b tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:46.667321 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-9c7ad79e-151c-4865-a63f-a080562b6b9b tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: 61889472-0e20-46bc-94d3-c4c42883a5b4] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:46.673381 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9c7ad79e-151c-4865-a63f-a080562b6b9b tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:46.673822 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9c7ad79e-151c-4865-a63f-a080562b6b9b tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:46.674608 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9c7ad79e-151c-4865-a63f-a080562b6b9b tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:46.675036 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9c7ad79e-151c-4865-a63f-a080562b6b9b tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:46.700245 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-9c7ad79e-151c-4865-a63f-a080562b6b9b tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: 61889472-0e20-46bc-94d3-c4c42883a5b4] Going to try to terminate instance {{(pid=114106) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 19 08:27:46.750541 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-2fccb3e6-1e9c-4e27-a619-de620657c36a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:46.759904 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2fccb3e6-1e9c-4e27-a619-de620657c36a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1567 microversion: 2.1 time: 0.144530 Oct 19 08:27:46.760556 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 349/704] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:46 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1567 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:27:46.779683 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-9c7ad79e-151c-4865-a63f-a080562b6b9b tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "DELETE /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4" status: 204 len: 0 microversion: 2.1 time: 0.116062 Oct 19 08:27:46.780249 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 356/705] 10.222.0.26 () {58 vars in 1238 bytes} [Tue Oct 19 08:27:46 2021] DELETE /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 08:27:46.788856 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-753a6bd7-39e1-4c1c-85f2-e5f69916d4d1 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:46.789456 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-753a6bd7-39e1-4c1c-85f2-e5f69916d4d1 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: 61889472-0e20-46bc-94d3-c4c42883a5b4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:46.795315 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-753a6bd7-39e1-4c1c-85f2-e5f69916d4d1 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:46.795755 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-753a6bd7-39e1-4c1c-85f2-e5f69916d4d1 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:46.796508 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-753a6bd7-39e1-4c1c-85f2-e5f69916d4d1 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:46.796946 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-753a6bd7-39e1-4c1c-85f2-e5f69916d4d1 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:46.916602 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-753a6bd7-39e1-4c1c-85f2-e5f69916d4d1 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:46.923774 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-753a6bd7-39e1-4c1c-85f2-e5f69916d4d1 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4" status: 200 len: 1512 microversion: 2.1 time: 0.139078 Oct 19 08:27:46.924262 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 350/706] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:46 2021] GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4 => generated 1512 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:27:47.173134 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-eddabdf3-e540-41b7-977b-f150cc5f65e1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:47.174482 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-eddabdf3-e540-41b7-977b-f150cc5f65e1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:47.188640 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-eddabdf3-e540-41b7-977b-f150cc5f65e1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:47.188640 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-eddabdf3-e540-41b7-977b-f150cc5f65e1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:47.188640 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-eddabdf3-e540-41b7-977b-f150cc5f65e1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:47.188640 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-eddabdf3-e540-41b7-977b-f150cc5f65e1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:47.216466 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2ceff52c-c2d8-4832-aaf7-ec8b0b34c07d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:47.217700 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2ceff52c-c2d8-4832-aaf7-ec8b0b34c07d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:47.224183 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2ceff52c-c2d8-4832-aaf7-ec8b0b34c07d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:47.224643 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2ceff52c-c2d8-4832-aaf7-ec8b0b34c07d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:47.225476 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2ceff52c-c2d8-4832-aaf7-ec8b0b34c07d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:47.226051 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2ceff52c-c2d8-4832-aaf7-ec8b0b34c07d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:47.251631 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-eddabdf3-e540-41b7-977b-f150cc5f65e1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.083147 Oct 19 08:27:47.256592 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 357/707] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:47 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:27:47.311443 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2ceff52c-c2d8-4832-aaf7-ec8b0b34c07d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.098460 Oct 19 08:27:47.312082 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 351/708] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:47 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:27:47.576429 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-daa5eb04-6f32-449d-a230-fca9a8c3d6c2 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:47.577419 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-daa5eb04-6f32-449d-a230-fca9a8c3d6c2 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:47.583757 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-daa5eb04-6f32-449d-a230-fca9a8c3d6c2 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:47.584198 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-daa5eb04-6f32-449d-a230-fca9a8c3d6c2 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:47.584956 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-daa5eb04-6f32-449d-a230-fca9a8c3d6c2 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:47.585381 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-daa5eb04-6f32-449d-a230-fca9a8c3d6c2 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:47.615499 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-daa5eb04-6f32-449d-a230-fca9a8c3d6c2 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043085 Oct 19 08:27:47.616057 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 358/709] 10.222.0.26 () {58 vars in 1301 bytes} [Tue Oct 19 08:27:47 2021] GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 08:27:47.780129 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-a5682709-076d-490c-a572-c111a8d99d57 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:47.780781 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-a5682709-076d-490c-a572-c111a8d99d57 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:47.787512 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a5682709-076d-490c-a572-c111a8d99d57 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:47.788026 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a5682709-076d-490c-a572-c111a8d99d57 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:47.788873 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a5682709-076d-490c-a572-c111a8d99d57 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:47.789371 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a5682709-076d-490c-a572-c111a8d99d57 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:47.919850 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-a5682709-076d-490c-a572-c111a8d99d57 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:47.924542 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-a5682709-076d-490c-a572-c111a8d99d57 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1567 microversion: 2.1 time: 0.148644 Oct 19 08:27:47.926522 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 352/710] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:47 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:47.940684 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c62fd527-5ba7-4fa6-9254-7c240e814151 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:47.941973 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c62fd527-5ba7-4fa6-9254-7c240e814151 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: 61889472-0e20-46bc-94d3-c4c42883a5b4] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:47.947630 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c62fd527-5ba7-4fa6-9254-7c240e814151 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:47.948001 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c62fd527-5ba7-4fa6-9254-7c240e814151 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:47.948763 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c62fd527-5ba7-4fa6-9254-7c240e814151 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:47.949161 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c62fd527-5ba7-4fa6-9254-7c240e814151 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:48.072241 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-c62fd527-5ba7-4fa6-9254-7c240e814151 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:48.080089 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c62fd527-5ba7-4fa6-9254-7c240e814151 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4" status: 200 len: 1512 microversion: 2.1 time: 0.142898 Oct 19 08:27:48.080676 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 359/711] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:47 2021] GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4 => generated 1512 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:48.263582 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-23b52443-30a3-47de-a4a6-d502d487f531 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:48.264511 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-23b52443-30a3-47de-a4a6-d502d487f531 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:48.270478 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-23b52443-30a3-47de-a4a6-d502d487f531 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:48.270945 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-23b52443-30a3-47de-a4a6-d502d487f531 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:48.271701 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-23b52443-30a3-47de-a4a6-d502d487f531 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:48.272125 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-23b52443-30a3-47de-a4a6-d502d487f531 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:48.322956 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b3b56717-3e04-4d03-b7b0-3462f1c55f78 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:48.324028 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b3b56717-3e04-4d03-b7b0-3462f1c55f78 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:48.329842 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b3b56717-3e04-4d03-b7b0-3462f1c55f78 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:48.330351 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b3b56717-3e04-4d03-b7b0-3462f1c55f78 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:48.331150 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b3b56717-3e04-4d03-b7b0-3462f1c55f78 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:48.331644 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b3b56717-3e04-4d03-b7b0-3462f1c55f78 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:48.353965 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-23b52443-30a3-47de-a4a6-d502d487f531 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.093834 Oct 19 08:27:48.357514 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 353/712] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:48 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:27:48.423264 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b3b56717-3e04-4d03-b7b0-3462f1c55f78 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.103696 Oct 19 08:27:48.423896 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 360/713] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:48 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:27:48.803576 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-cf931564-8581-449b-9b1d-ad5cfa8c4066 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:48.804163 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-cf931564-8581-449b-9b1d-ad5cfa8c4066 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:48.811281 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cf931564-8581-449b-9b1d-ad5cfa8c4066 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:48.811717 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cf931564-8581-449b-9b1d-ad5cfa8c4066 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:48.812598 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cf931564-8581-449b-9b1d-ad5cfa8c4066 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:48.813159 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cf931564-8581-449b-9b1d-ad5cfa8c4066 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:48.841128 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-cf931564-8581-449b-9b1d-ad5cfa8c4066 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] Going to try to terminate instance {{(pid=114105) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 19 08:27:48.921327 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-cf931564-8581-449b-9b1d-ad5cfa8c4066 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6" status: 204 len: 0 microversion: 2.1 time: 0.122001 Oct 19 08:27:48.921907 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 354/714] 10.222.0.26 () {58 vars in 1238 bytes} [Tue Oct 19 08:27:48 2021] DELETE /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 08:27:48.930862 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c5da8c98-919b-4e6c-8dd7-bf3f4a89880c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:48.931750 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c5da8c98-919b-4e6c-8dd7-bf3f4a89880c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:48.938870 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c5da8c98-919b-4e6c-8dd7-bf3f4a89880c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:48.939401 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c5da8c98-919b-4e6c-8dd7-bf3f4a89880c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:48.940095 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c5da8c98-919b-4e6c-8dd7-bf3f4a89880c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:48.940520 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c5da8c98-919b-4e6c-8dd7-bf3f4a89880c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:48.949042 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-35af6e01-3485-416e-bdfe-fe2cc41ce516 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:48.950429 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-35af6e01-3485-416e-bdfe-fe2cc41ce516 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:48.957828 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-35af6e01-3485-416e-bdfe-fe2cc41ce516 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:48.958443 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-35af6e01-3485-416e-bdfe-fe2cc41ce516 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:48.960131 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-35af6e01-3485-416e-bdfe-fe2cc41ce516 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:48.960664 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-35af6e01-3485-416e-bdfe-fe2cc41ce516 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:49.129591 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-c5da8c98-919b-4e6c-8dd7-bf3f4a89880c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:49.134430 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-35af6e01-3485-416e-bdfe-fe2cc41ce516 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:49.137556 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c5da8c98-919b-4e6c-8dd7-bf3f4a89880c tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6" status: 200 len: 1514 microversion: 2.1 time: 0.210780 Oct 19 08:27:49.138122 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 361/715] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:48 2021] GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6 => generated 1514 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:49.147172 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-55619098-72df-4587-869f-c7de404112e7 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:49.147172 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-55619098-72df-4587-869f-c7de404112e7 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: 61889472-0e20-46bc-94d3-c4c42883a5b4] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:49.149259 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-55619098-72df-4587-869f-c7de404112e7 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:49.149701 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-55619098-72df-4587-869f-c7de404112e7 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:49.150472 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-55619098-72df-4587-869f-c7de404112e7 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:49.150929 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-55619098-72df-4587-869f-c7de404112e7 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:49.153396 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-35af6e01-3485-416e-bdfe-fe2cc41ce516 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1567 microversion: 2.1 time: 0.214427 Oct 19 08:27:49.154232 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 355/716] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:48 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1567 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:49.275606 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-55619098-72df-4587-869f-c7de404112e7 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:49.283764 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-55619098-72df-4587-869f-c7de404112e7 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4" status: 200 len: 1512 microversion: 2.1 time: 0.144480 Oct 19 08:27:49.284365 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 362/717] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:49 2021] GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4 => generated 1512 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:49.369247 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-0a227323-ec5a-430a-a87c-48ab391fc2c0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:49.369247 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-0a227323-ec5a-430a-a87c-48ab391fc2c0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:49.371819 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0a227323-ec5a-430a-a87c-48ab391fc2c0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:49.372284 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0a227323-ec5a-430a-a87c-48ab391fc2c0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:49.373040 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0a227323-ec5a-430a-a87c-48ab391fc2c0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:49.373462 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0a227323-ec5a-430a-a87c-48ab391fc2c0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:49.435591 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c229d539-3643-4f4b-82fa-d759444a601c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:49.436737 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c229d539-3643-4f4b-82fa-d759444a601c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:49.442788 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c229d539-3643-4f4b-82fa-d759444a601c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:49.443311 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c229d539-3643-4f4b-82fa-d759444a601c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:49.444159 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c229d539-3643-4f4b-82fa-d759444a601c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:49.444663 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c229d539-3643-4f4b-82fa-d759444a601c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:49.468546 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-0a227323-ec5a-430a-a87c-48ab391fc2c0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.106918 Oct 19 08:27:49.470591 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 356/718] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:49 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:27:49.520776 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c229d539-3643-4f4b-82fa-d759444a601c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.088588 Oct 19 08:27:49.522347 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 363/719] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:49 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:27:49.901427 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-ebf5a87d-3724-4724-9b27-4fb14a08f0cd req-3daac7ed-22e1-4bc1-8336-74558ebcd218 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61889472-0e20-46bc-94d3-c4c42883a5b4", "name": "network-vif-deleted", "tag": "a4cb6d5a-dee1-4c5d-802a-33281ff7b5a1"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:49.903525 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:27:49.903525 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:27:49.913013 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-ebf5a87d-3724-4724-9b27-4fb14a08f0cd req-3daac7ed-22e1-4bc1-8336-74558ebcd218 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:49.913383 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-ebf5a87d-3724-4724-9b27-4fb14a08f0cd req-3daac7ed-22e1-4bc1-8336-74558ebcd218 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:49.926573 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-ebf5a87d-3724-4724-9b27-4fb14a08f0cd req-3daac7ed-22e1-4bc1-8336-74558ebcd218 service nova] Creating event network-vif-deleted:a4cb6d5a-dee1-4c5d-802a-33281ff7b5a1 for instance 61889472-0e20-46bc-94d3-c4c42883a5b4 on hv-cinder-81398 Oct 19 08:27:49.931963 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-ebf5a87d-3724-4724-9b27-4fb14a08f0cd req-3daac7ed-22e1-4bc1-8336-74558ebcd218 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035015 Oct 19 08:27:49.932912 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 357/720] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:27:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:27:50.155442 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-0ad2caec-08c3-4f99-afd0-b0826e4a8f02 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:50.156137 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-0ad2caec-08c3-4f99-afd0-b0826e4a8f02 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:50.165596 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0ad2caec-08c3-4f99-afd0-b0826e4a8f02 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:50.166268 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0ad2caec-08c3-4f99-afd0-b0826e4a8f02 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:50.167529 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0ad2caec-08c3-4f99-afd0-b0826e4a8f02 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:50.167967 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0ad2caec-08c3-4f99-afd0-b0826e4a8f02 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:50.171447 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-642888a6-d11c-4e9c-b018-24bc39ec421d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:50.172143 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-642888a6-d11c-4e9c-b018-24bc39ec421d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:50.179602 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-642888a6-d11c-4e9c-b018-24bc39ec421d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:50.180271 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-642888a6-d11c-4e9c-b018-24bc39ec421d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:50.181318 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-642888a6-d11c-4e9c-b018-24bc39ec421d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:50.181747 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-642888a6-d11c-4e9c-b018-24bc39ec421d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:50.360009 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-642888a6-d11c-4e9c-b018-24bc39ec421d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:50.363991 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-0ad2caec-08c3-4f99-afd0-b0826e4a8f02 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:50.368146 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-642888a6-d11c-4e9c-b018-24bc39ec421d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1567 microversion: 2.1 time: 0.200621 Oct 19 08:27:50.368716 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 358/721] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:50 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1567 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:27:50.372947 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-0c73f219-5c1e-45b2-b5d2-f8d016c1835a tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:50.373541 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-0c73f219-5c1e-45b2-b5d2-f8d016c1835a tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: 61889472-0e20-46bc-94d3-c4c42883a5b4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:50.375211 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-0ad2caec-08c3-4f99-afd0-b0826e4a8f02 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6" status: 200 len: 1514 microversion: 2.1 time: 0.221076 Oct 19 08:27:50.377167 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 364/722] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:50 2021] GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6 => generated 1514 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:50.383341 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0c73f219-5c1e-45b2-b5d2-f8d016c1835a tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:50.383788 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0c73f219-5c1e-45b2-b5d2-f8d016c1835a tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:50.384560 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0c73f219-5c1e-45b2-b5d2-f8d016c1835a tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:50.384982 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0c73f219-5c1e-45b2-b5d2-f8d016c1835a tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:50.422776 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0c73f219-5c1e-45b2-b5d2-f8d016c1835a tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:50.423408 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0c73f219-5c1e-45b2-b5d2-f8d016c1835a tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:50.423865 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.objects.instance [None req-0c73f219-5c1e-45b2-b5d2-f8d016c1835a tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lazy-loading 'fault' on Instance uuid 61889472-0e20-46bc-94d3-c4c42883a5b4 {{(pid=114105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 19 08:27:50.472366 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-0c73f219-5c1e-45b2-b5d2-f8d016c1835a tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:50.480049 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-0c73f219-5c1e-45b2-b5d2-f8d016c1835a tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4" status: 200 len: 1307 microversion: 2.1 time: 0.110360 Oct 19 08:27:50.482540 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-d3de5b53-8c80-48a2-926b-830ec6379583 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:50.483038 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 359/723] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:50 2021] GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4 => generated 1307 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:50.483129 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-d3de5b53-8c80-48a2-926b-830ec6379583 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:50.489199 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d3de5b53-8c80-48a2-926b-830ec6379583 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:50.489649 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d3de5b53-8c80-48a2-926b-830ec6379583 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:50.490427 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d3de5b53-8c80-48a2-926b-830ec6379583 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:50.490886 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d3de5b53-8c80-48a2-926b-830ec6379583 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:50.532800 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-06e6fb35-8c6b-4135-817e-afc0182dacaa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:50.533762 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-06e6fb35-8c6b-4135-817e-afc0182dacaa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:50.539841 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-06e6fb35-8c6b-4135-817e-afc0182dacaa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:50.540278 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-06e6fb35-8c6b-4135-817e-afc0182dacaa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:50.541041 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-06e6fb35-8c6b-4135-817e-afc0182dacaa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:50.541464 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-06e6fb35-8c6b-4135-817e-afc0182dacaa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:50.668978 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-d3de5b53-8c80-48a2-926b-830ec6379583 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.191310 Oct 19 08:27:50.669834 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 365/724] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:50 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:27:50.677157 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-06e6fb35-8c6b-4135-817e-afc0182dacaa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.148052 Oct 19 08:27:50.677794 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 360/725] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:50 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:27:51.390155 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-bdaabd99-61b7-4696-92bc-d69f2cd0deb1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:51.391037 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-bdaabd99-61b7-4696-92bc-d69f2cd0deb1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:51.393120 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-cfd0b4a4-c27a-44c1-8212-a509d50af11b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:51.394028 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-cfd0b4a4-c27a-44c1-8212-a509d50af11b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:51.398229 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bdaabd99-61b7-4696-92bc-d69f2cd0deb1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:51.398976 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bdaabd99-61b7-4696-92bc-d69f2cd0deb1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:51.399863 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bdaabd99-61b7-4696-92bc-d69f2cd0deb1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:51.400484 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bdaabd99-61b7-4696-92bc-d69f2cd0deb1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:51.403460 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cfd0b4a4-c27a-44c1-8212-a509d50af11b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:51.403906 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cfd0b4a4-c27a-44c1-8212-a509d50af11b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:51.404675 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cfd0b4a4-c27a-44c1-8212-a509d50af11b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:51.405106 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cfd0b4a4-c27a-44c1-8212-a509d50af11b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:51.575768 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-cfd0b4a4-c27a-44c1-8212-a509d50af11b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:51.580484 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-bdaabd99-61b7-4696-92bc-d69f2cd0deb1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:51.583828 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-cfd0b4a4-c27a-44c1-8212-a509d50af11b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6" status: 200 len: 1514 microversion: 2.1 time: 0.194588 Oct 19 08:27:51.584394 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 361/726] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:51 2021] GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6 => generated 1514 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:27:51.588617 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2c2c6468-3f61-4b5f-8b01-f9949f581c99 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:51.589115 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-bdaabd99-61b7-4696-92bc-d69f2cd0deb1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1567 microversion: 2.1 time: 0.203696 Oct 19 08:27:51.589281 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2c2c6468-3f61-4b5f-8b01-f9949f581c99 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: 61889472-0e20-46bc-94d3-c4c42883a5b4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:51.589872 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 366/727] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:51 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:51.595196 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2c2c6468-3f61-4b5f-8b01-f9949f581c99 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:51.595573 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2c2c6468-3f61-4b5f-8b01-f9949f581c99 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:51.596324 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2c2c6468-3f61-4b5f-8b01-f9949f581c99 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:51.596743 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2c2c6468-3f61-4b5f-8b01-f9949f581c99 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:51.610820 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.wsgi [None req-2c2c6468-3f61-4b5f-8b01-f9949f581c99 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] HTTP exception thrown: Instance 61889472-0e20-46bc-94d3-c4c42883a5b4 could not be found. Oct 19 08:27:51.611408 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2c2c6468-3f61-4b5f-8b01-f9949f581c99 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Returning 404 to user: Instance 61889472-0e20-46bc-94d3-c4c42883a5b4 could not be found. {{(pid=114105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:27:51.612230 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2c2c6468-3f61-4b5f-8b01-f9949f581c99 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4" status: 404 len: 111 microversion: 2.1 time: 0.026931 Oct 19 08:27:51.613292 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 362/728] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:51 2021] GET /compute/v2.1/servers/61889472-0e20-46bc-94d3-c4c42883a5b4 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:27:51.679594 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-57a289fe-5ec9-41fb-9ea3-8e5845b234f7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:51.680581 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-57a289fe-5ec9-41fb-9ea3-8e5845b234f7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:51.686437 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-57a289fe-5ec9-41fb-9ea3-8e5845b234f7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:51.686929 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-57a289fe-5ec9-41fb-9ea3-8e5845b234f7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:51.687732 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-57a289fe-5ec9-41fb-9ea3-8e5845b234f7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:51.688463 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-57a289fe-5ec9-41fb-9ea3-8e5845b234f7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:51.688843 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-9ddbc087-51f3-4970-9648-7e6ecc448821 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:51.689806 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-9ddbc087-51f3-4970-9648-7e6ecc448821 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:51.695681 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9ddbc087-51f3-4970-9648-7e6ecc448821 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:51.696114 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9ddbc087-51f3-4970-9648-7e6ecc448821 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:51.696876 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9ddbc087-51f3-4970-9648-7e6ecc448821 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:51.697304 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9ddbc087-51f3-4970-9648-7e6ecc448821 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:52.026914 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-57a289fe-5ec9-41fb-9ea3-8e5845b234f7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.350765 Oct 19 08:27:52.027549 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 367/729] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:51 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:27:52.041647 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-9ddbc087-51f3-4970-9648-7e6ecc448821 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.356242 Oct 19 08:27:52.042264 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 363/730] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:51 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:27:52.601315 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-9c3ea828-f14b-444d-be4a-31522bf996bd tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:52.603047 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-9c3ea828-f14b-444d-be4a-31522bf996bd tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:52.609456 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d36dec48-2036-46b2-85e1-f5876549ba9e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:52.609940 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9c3ea828-f14b-444d-be4a-31522bf996bd tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:52.610048 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9c3ea828-f14b-444d-be4a-31522bf996bd tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:52.610134 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-d36dec48-2036-46b2-85e1-f5876549ba9e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:52.610798 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9c3ea828-f14b-444d-be4a-31522bf996bd tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:52.611230 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9c3ea828-f14b-444d-be4a-31522bf996bd tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:52.617263 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d36dec48-2036-46b2-85e1-f5876549ba9e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:52.617936 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d36dec48-2036-46b2-85e1-f5876549ba9e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:52.619078 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d36dec48-2036-46b2-85e1-f5876549ba9e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:52.619845 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d36dec48-2036-46b2-85e1-f5876549ba9e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:52.683586 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-9c3ea828-f14b-444d-be4a-31522bf996bd tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:52.690942 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-9c3ea828-f14b-444d-be4a-31522bf996bd tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6" status: 200 len: 1472 microversion: 2.1 time: 0.093859 Oct 19 08:27:52.691508 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 368/731] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:52 2021] GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6 => generated 1472 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:52.695867 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-58b48832-abf1-4de9-8983-77d6de9161bf req-ae8b3908-37d8-4e8a-a05c-188e20ff4238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fefb359-52da-4d34-bb64-0201467132b6", "name": "network-vif-deleted", "tag": "4d7c1ec2-ee4e-49ac-9c22-383e5a58b567"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:52.697334 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:27:52.697334 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:27:52.703809 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-58b48832-abf1-4de9-8983-77d6de9161bf req-ae8b3908-37d8-4e8a-a05c-188e20ff4238 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:52.704234 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-58b48832-abf1-4de9-8983-77d6de9161bf req-ae8b3908-37d8-4e8a-a05c-188e20ff4238 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:52.714776 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-58b48832-abf1-4de9-8983-77d6de9161bf req-ae8b3908-37d8-4e8a-a05c-188e20ff4238 service nova] Creating event network-vif-deleted:4d7c1ec2-ee4e-49ac-9c22-383e5a58b567 for instance 5fefb359-52da-4d34-bb64-0201467132b6 on hv-cinder-81398 Oct 19 08:27:52.719448 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-58b48832-abf1-4de9-8983-77d6de9161bf req-ae8b3908-37d8-4e8a-a05c-188e20ff4238 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.026879 Oct 19 08:27:52.720045 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 369/732] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:27:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:27:52.760424 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-d36dec48-2036-46b2-85e1-f5876549ba9e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:52.767909 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-d36dec48-2036-46b2-85e1-f5876549ba9e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1567 microversion: 2.1 time: 0.164840 Oct 19 08:27:52.768454 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 364/733] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:52 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:53.040181 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-4ca5235e-42b0-4c35-b6f3-83a66bcc9af8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:53.041135 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-4ca5235e-42b0-4c35-b6f3-83a66bcc9af8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:53.047036 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4ca5235e-42b0-4c35-b6f3-83a66bcc9af8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:53.047475 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4ca5235e-42b0-4c35-b6f3-83a66bcc9af8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:53.048213 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4ca5235e-42b0-4c35-b6f3-83a66bcc9af8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:53.048631 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4ca5235e-42b0-4c35-b6f3-83a66bcc9af8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:53.056250 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-afe2ecee-31d5-449e-8513-8e461751dee6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:53.057147 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-afe2ecee-31d5-449e-8513-8e461751dee6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:53.062815 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-afe2ecee-31d5-449e-8513-8e461751dee6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:53.063252 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-afe2ecee-31d5-449e-8513-8e461751dee6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:53.064003 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-afe2ecee-31d5-449e-8513-8e461751dee6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:53.064424 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-afe2ecee-31d5-449e-8513-8e461751dee6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:56.589372 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-afe2ecee-31d5-449e-8513-8e461751dee6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 3.536497 Oct 19 08:27:56.590715 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 365/734] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:53 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 3539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:27:56.596034 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-a6f0b051-3f77-49e2-a8d1-af55b09e1aaf tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:56.596197 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-4ca5235e-42b0-4c35-b6f3-83a66bcc9af8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 3.559776 Oct 19 08:27:56.597618 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 370/735] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:53 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 3563 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:27:56.600159 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-a6f0b051-3f77-49e2-a8d1-af55b09e1aaf tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:56.607009 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a6f0b051-3f77-49e2-a8d1-af55b09e1aaf tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:56.607454 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a6f0b051-3f77-49e2-a8d1-af55b09e1aaf tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:56.608226 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a6f0b051-3f77-49e2-a8d1-af55b09e1aaf tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:56.608358 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-20e07007-c04c-42a7-814e-ee09518c61b1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:56.608657 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a6f0b051-3f77-49e2-a8d1-af55b09e1aaf tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:56.609083 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-20e07007-c04c-42a7-814e-ee09518c61b1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:56.617291 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-20e07007-c04c-42a7-814e-ee09518c61b1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:56.617821 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-20e07007-c04c-42a7-814e-ee09518c61b1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:56.619273 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-20e07007-c04c-42a7-814e-ee09518c61b1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:56.619779 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-20e07007-c04c-42a7-814e-ee09518c61b1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:56.646022 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a6f0b051-3f77-49e2-a8d1-af55b09e1aaf tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:56.646475 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a6f0b051-3f77-49e2-a8d1-af55b09e1aaf tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:56.646953 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.objects.instance [None req-a6f0b051-3f77-49e2-a8d1-af55b09e1aaf tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lazy-loading 'fault' on Instance uuid 5fefb359-52da-4d34-bb64-0201467132b6 {{(pid=114105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 19 08:27:56.714471 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-a6f0b051-3f77-49e2-a8d1-af55b09e1aaf tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:56.721645 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-a6f0b051-3f77-49e2-a8d1-af55b09e1aaf tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6" status: 200 len: 1307 microversion: 2.1 time: 0.129529 Oct 19 08:27:56.722801 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 366/736] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:56 2021] GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6 => generated 1307 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:56.767985 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-20e07007-c04c-42a7-814e-ee09518c61b1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:56.776235 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-20e07007-c04c-42a7-814e-ee09518c61b1 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1567 microversion: 2.1 time: 0.177443 Oct 19 08:27:56.776792 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 371/737] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:56 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:57.603440 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-88ebbd89-e027-44f4-ac2d-fc06f28cc749 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:57.604063 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-88ebbd89-e027-44f4-ac2d-fc06f28cc749 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:57.608238 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e5cc944d-6ac1-4899-a19b-2856a161fd09 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:57.609220 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e5cc944d-6ac1-4899-a19b-2856a161fd09 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:57.610976 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-88ebbd89-e027-44f4-ac2d-fc06f28cc749 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:57.611929 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-88ebbd89-e027-44f4-ac2d-fc06f28cc749 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:57.612212 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-88ebbd89-e027-44f4-ac2d-fc06f28cc749 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:57.613511 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-88ebbd89-e027-44f4-ac2d-fc06f28cc749 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:57.616238 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e5cc944d-6ac1-4899-a19b-2856a161fd09 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:57.616677 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e5cc944d-6ac1-4899-a19b-2856a161fd09 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:57.617472 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e5cc944d-6ac1-4899-a19b-2856a161fd09 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:57.617897 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e5cc944d-6ac1-4899-a19b-2856a161fd09 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:57.974236 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e5cc944d-6ac1-4899-a19b-2856a161fd09 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.369788 Oct 19 08:27:57.982075 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 372/738] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:57 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:27:57.982180 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-88ebbd89-e027-44f4-ac2d-fc06f28cc749 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.377608 Oct 19 08:27:57.982180 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 367/739] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:57 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:27:57.982337 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-cce12ec1-2157-443f-91e7-3ed46df4b676 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:57.982337 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-cce12ec1-2157-443f-91e7-3ed46df4b676 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 5fefb359-52da-4d34-bb64-0201467132b6] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:57.983008 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8a2289ab-0efd-4449-bfc0-ab139ff3f829 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:57.983690 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-8a2289ab-0efd-4449-bfc0-ab139ff3f829 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:57.988414 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cce12ec1-2157-443f-91e7-3ed46df4b676 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:57.988858 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cce12ec1-2157-443f-91e7-3ed46df4b676 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:57.989814 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cce12ec1-2157-443f-91e7-3ed46df4b676 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:57.990546 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cce12ec1-2157-443f-91e7-3ed46df4b676 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:57.991087 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8a2289ab-0efd-4449-bfc0-ab139ff3f829 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:57.991533 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8a2289ab-0efd-4449-bfc0-ab139ff3f829 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:57.992312 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8a2289ab-0efd-4449-bfc0-ab139ff3f829 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:57.992742 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8a2289ab-0efd-4449-bfc0-ab139ff3f829 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:58.004630 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.wsgi [None req-cce12ec1-2157-443f-91e7-3ed46df4b676 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] HTTP exception thrown: Instance 5fefb359-52da-4d34-bb64-0201467132b6 could not be found. Oct 19 08:27:58.005220 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-cce12ec1-2157-443f-91e7-3ed46df4b676 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Returning 404 to user: Instance 5fefb359-52da-4d34-bb64-0201467132b6 could not be found. {{(pid=114106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:27:58.006023 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-cce12ec1-2157-443f-91e7-3ed46df4b676 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6" status: 404 len: 111 microversion: 2.1 time: 0.029126 Oct 19 08:27:58.006846 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 373/740] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:57 2021] GET /compute/v2.1/servers/5fefb359-52da-4d34-bb64-0201467132b6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:27:58.134322 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-8a2289ab-0efd-4449-bfc0-ab139ff3f829 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:58.143880 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-8a2289ab-0efd-4449-bfc0-ab139ff3f829 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1567 microversion: 2.1 time: 0.164212 Oct 19 08:27:58.144111 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 368/741] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:57 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:27:58.989125 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-1a9696ef-c946-469c-9550-d2ae63c9228b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:58.989668 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-47954d8d-5563-4d30-bf12-d8c4c9bead9e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:27:58.990053 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-1a9696ef-c946-469c-9550-d2ae63c9228b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:58.990446 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-47954d8d-5563-4d30-bf12-d8c4c9bead9e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:58.996144 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1a9696ef-c946-469c-9550-d2ae63c9228b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:58.996584 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1a9696ef-c946-469c-9550-d2ae63c9228b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:58.996771 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-47954d8d-5563-4d30-bf12-d8c4c9bead9e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:58.997028 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-47954d8d-5563-4d30-bf12-d8c4c9bead9e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:58.997336 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1a9696ef-c946-469c-9550-d2ae63c9228b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:58.997772 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1a9696ef-c946-469c-9550-d2ae63c9228b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:58.997871 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-47954d8d-5563-4d30-bf12-d8c4c9bead9e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:58.998191 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-47954d8d-5563-4d30-bf12-d8c4c9bead9e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:59.117689 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-1a9696ef-c946-469c-9550-d2ae63c9228b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.132799 Oct 19 08:27:59.118303 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 374/742] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:27:58 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:27:59.125818 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-47954d8d-5563-4d30-bf12-d8c4c9bead9e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.140443 Oct 19 08:27:59.126463 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 369/743] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:27:58 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:27:59.145401 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-53fedc60-dde9-455b-96e1-1481dce20191 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:59.146180 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-53fedc60-dde9-455b-96e1-1481dce20191 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:59.152666 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-53fedc60-dde9-455b-96e1-1481dce20191 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:59.153093 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-53fedc60-dde9-455b-96e1-1481dce20191 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:59.155489 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-53fedc60-dde9-455b-96e1-1481dce20191 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:59.155489 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-53fedc60-dde9-455b-96e1-1481dce20191 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:59.161544 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-ca90b4ee-bec8-4b7f-85e6-ff8e5b75214a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:59.162415 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-ca90b4ee-bec8-4b7f-85e6-ff8e5b75214a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:59.169403 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ca90b4ee-bec8-4b7f-85e6-ff8e5b75214a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:59.169848 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ca90b4ee-bec8-4b7f-85e6-ff8e5b75214a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:59.170651 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ca90b4ee-bec8-4b7f-85e6-ff8e5b75214a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:59.171081 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ca90b4ee-bec8-4b7f-85e6-ff8e5b75214a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:59.182938 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-53fedc60-dde9-455b-96e1-1481dce20191 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Going to try to terminate instance {{(pid=114106) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 19 08:27:59.273071 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-53fedc60-dde9-455b-96e1-1481dce20191 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 204 len: 0 microversion: 2.1 time: 0.132016 Oct 19 08:27:59.276596 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 375/744] 10.222.0.26 () {58 vars in 1238 bytes} [Tue Oct 19 08:27:59 2021] DELETE /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 08:27:59.284582 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-caf46729-fa27-42af-b9b3-46992531e051 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:27:59.285632 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-caf46729-fa27-42af-b9b3-46992531e051 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:27:59.292743 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-caf46729-fa27-42af-b9b3-46992531e051 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:59.293188 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-caf46729-fa27-42af-b9b3-46992531e051 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:59.293956 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-caf46729-fa27-42af-b9b3-46992531e051 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:27:59.294380 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-caf46729-fa27-42af-b9b3-46992531e051 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:27:59.319877 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-ca90b4ee-bec8-4b7f-85e6-ff8e5b75214a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:59.334917 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-ca90b4ee-bec8-4b7f-85e6-ff8e5b75214a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1567 microversion: 2.1 time: 0.176687 Oct 19 08:27:59.335689 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 370/745] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:59 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:27:59.426755 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-caf46729-fa27-42af-b9b3-46992531e051 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:27:59.433938 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-caf46729-fa27-42af-b9b3-46992531e051 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1514 microversion: 2.1 time: 0.155114 Oct 19 08:27:59.434509 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 376/746] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:27:59 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:00.129756 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8915456a-5006-4b17-9303-4f0c0332f9a2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:00.130693 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-8915456a-5006-4b17-9303-4f0c0332f9a2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:00.136676 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8915456a-5006-4b17-9303-4f0c0332f9a2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:00.137125 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8915456a-5006-4b17-9303-4f0c0332f9a2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:00.137252 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-f0147536-3838-498b-8c4e-c3432587ea42 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:00.137891 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8915456a-5006-4b17-9303-4f0c0332f9a2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:00.138091 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-f0147536-3838-498b-8c4e-c3432587ea42 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:00.138327 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8915456a-5006-4b17-9303-4f0c0332f9a2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:00.144264 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f0147536-3838-498b-8c4e-c3432587ea42 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:00.144703 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f0147536-3838-498b-8c4e-c3432587ea42 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:00.145465 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f0147536-3838-498b-8c4e-c3432587ea42 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:00.145888 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f0147536-3838-498b-8c4e-c3432587ea42 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:00.336259 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-8915456a-5006-4b17-9303-4f0c0332f9a2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.210620 Oct 19 08:28:00.337101 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 371/747] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:28:00 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:28:00.352545 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-16cda634-a30c-404a-bb20-5a917dd61f4c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:00.353230 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-16cda634-a30c-404a-bb20-5a917dd61f4c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:00.359488 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-16cda634-a30c-404a-bb20-5a917dd61f4c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:00.359927 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-16cda634-a30c-404a-bb20-5a917dd61f4c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:00.360675 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-16cda634-a30c-404a-bb20-5a917dd61f4c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:00.361101 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-16cda634-a30c-404a-bb20-5a917dd61f4c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:00.368066 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-f0147536-3838-498b-8c4e-c3432587ea42 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.234277 Oct 19 08:28:00.370543 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 377/748] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:28:00 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:28:00.450547 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-06ee686e-339e-4932-9734-16adbf96fb76 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:00.451270 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-06ee686e-339e-4932-9734-16adbf96fb76 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:00.458350 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-06ee686e-339e-4932-9734-16adbf96fb76 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:00.458821 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-06ee686e-339e-4932-9734-16adbf96fb76 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:00.459582 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-06ee686e-339e-4932-9734-16adbf96fb76 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:00.460008 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-06ee686e-339e-4932-9734-16adbf96fb76 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:00.481529 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-16cda634-a30c-404a-bb20-5a917dd61f4c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:00.489665 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-16cda634-a30c-404a-bb20-5a917dd61f4c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1567 microversion: 2.1 time: 0.141014 Oct 19 08:28:00.490306 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 372/749] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:00 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1567 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:28:00.579958 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-06ee686e-339e-4932-9734-16adbf96fb76 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:00.587155 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-06ee686e-339e-4932-9734-16adbf96fb76 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1514 microversion: 2.1 time: 0.140529 Oct 19 08:28:00.587640 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 378/750] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:00 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1514 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:28:01.348709 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-fbaed06d-dd75-47d4-8927-2ddb52f9c7f0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:01.349607 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-fbaed06d-dd75-47d4-8927-2ddb52f9c7f0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:01.355484 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fbaed06d-dd75-47d4-8927-2ddb52f9c7f0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:01.355929 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fbaed06d-dd75-47d4-8927-2ddb52f9c7f0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:01.356680 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fbaed06d-dd75-47d4-8927-2ddb52f9c7f0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:01.357104 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fbaed06d-dd75-47d4-8927-2ddb52f9c7f0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:01.379618 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e3c129ac-03cc-4a6e-88ed-ea7a66cf3810 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:01.380511 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e3c129ac-03cc-4a6e-88ed-ea7a66cf3810 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:01.386338 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e3c129ac-03cc-4a6e-88ed-ea7a66cf3810 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:01.386811 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e3c129ac-03cc-4a6e-88ed-ea7a66cf3810 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:01.387556 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e3c129ac-03cc-4a6e-88ed-ea7a66cf3810 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:01.387973 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e3c129ac-03cc-4a6e-88ed-ea7a66cf3810 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:04.243740 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-fbaed06d-dd75-47d4-8927-2ddb52f9c7f0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 2.899225 Oct 19 08:28:04.244609 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 373/751] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:28:01 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 2901 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:28:04.246061 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e3c129ac-03cc-4a6e-88ed-ea7a66cf3810 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 2.869902 Oct 19 08:28:04.249800 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 379/752] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:28:01 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 2872 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:28:04.249945 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-10dad8b8-b199-429f-8ed8-8817625a883e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:04.250130 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-10dad8b8-b199-429f-8ed8-8817625a883e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:04.251797 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-270ae4bf-89d0-45f8-9171-5d933a7fd19e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:04.252473 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-270ae4bf-89d0-45f8-9171-5d933a7fd19e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:04.257274 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-10dad8b8-b199-429f-8ed8-8817625a883e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:04.257727 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-10dad8b8-b199-429f-8ed8-8817625a883e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:04.258511 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-10dad8b8-b199-429f-8ed8-8817625a883e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:04.258948 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-10dad8b8-b199-429f-8ed8-8817625a883e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:04.259453 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-270ae4bf-89d0-45f8-9171-5d933a7fd19e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:04.259889 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-270ae4bf-89d0-45f8-9171-5d933a7fd19e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:04.260641 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-270ae4bf-89d0-45f8-9171-5d933a7fd19e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:04.261063 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-270ae4bf-89d0-45f8-9171-5d933a7fd19e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:04.437040 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-10dad8b8-b199-429f-8ed8-8817625a883e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:04.439489 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-270ae4bf-89d0-45f8-9171-5d933a7fd19e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:04.446659 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-10dad8b8-b199-429f-8ed8-8817625a883e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1567 microversion: 2.1 time: 0.201130 Oct 19 08:28:04.447443 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 374/753] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:04 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1567 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:04.447729 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-270ae4bf-89d0-45f8-9171-5d933a7fd19e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1514 microversion: 2.1 time: 0.199351 Oct 19 08:28:04.448226 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 380/754] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:04 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1514 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:05.255501 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8c8425d3-6f93-4034-b5fa-f6ebf5aa3f77 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:05.256327 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-8c8425d3-6f93-4034-b5fa-f6ebf5aa3f77 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:05.257285 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-076c2952-7704-4771-9cd5-d943fea41e8f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:05.258194 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-076c2952-7704-4771-9cd5-d943fea41e8f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:05.262997 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8c8425d3-6f93-4034-b5fa-f6ebf5aa3f77 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:05.263466 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8c8425d3-6f93-4034-b5fa-f6ebf5aa3f77 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:05.264229 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8c8425d3-6f93-4034-b5fa-f6ebf5aa3f77 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:05.264336 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-076c2952-7704-4771-9cd5-d943fea41e8f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:05.264654 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8c8425d3-6f93-4034-b5fa-f6ebf5aa3f77 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:05.264764 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-076c2952-7704-4771-9cd5-d943fea41e8f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:05.265503 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-076c2952-7704-4771-9cd5-d943fea41e8f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:05.265928 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-076c2952-7704-4771-9cd5-d943fea41e8f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:05.561658 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-076c2952-7704-4771-9cd5-d943fea41e8f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.306876 Oct 19 08:28:05.562455 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 381/755] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:28:05 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:28:05.567050 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-8c8425d3-6f93-4034-b5fa-f6ebf5aa3f77 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.315174 Oct 19 08:28:05.568441 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 375/756] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:28:05 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:28:05.574129 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b92a4117-894d-4375-bda1-91eb653ed772 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:05.576234 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b92a4117-894d-4375-bda1-91eb653ed772 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:05.577814 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2605f43c-7192-444d-8c4b-3349d27643ca tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:05.578613 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2605f43c-7192-444d-8c4b-3349d27643ca tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:05.583579 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b92a4117-894d-4375-bda1-91eb653ed772 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:05.584020 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b92a4117-894d-4375-bda1-91eb653ed772 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:05.584784 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b92a4117-894d-4375-bda1-91eb653ed772 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:05.585205 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b92a4117-894d-4375-bda1-91eb653ed772 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:05.585734 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2605f43c-7192-444d-8c4b-3349d27643ca tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:05.586245 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2605f43c-7192-444d-8c4b-3349d27643ca tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:05.587105 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2605f43c-7192-444d-8c4b-3349d27643ca tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:05.587619 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2605f43c-7192-444d-8c4b-3349d27643ca tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:05.760719 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-b92a4117-894d-4375-bda1-91eb653ed772 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:05.765299 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-2605f43c-7192-444d-8c4b-3349d27643ca tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:05.768632 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b92a4117-894d-4375-bda1-91eb653ed772 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1567 microversion: 2.1 time: 0.198976 Oct 19 08:28:05.769768 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 382/757] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:05 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:05.773386 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2605f43c-7192-444d-8c4b-3349d27643ca tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1514 microversion: 2.1 time: 0.204541 Oct 19 08:28:05.773932 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 376/758] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:05 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1514 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:05.774853 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-2d2abdb5-2780-44db-ba80-71fcb4bb2649 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-873537621", "imageRef": "9102a998-a580-4b4e-b6a1-3172273dd66d", "flavorRef": "452", "networks": [{"uuid": "3f69f0bf-630e-493a-a010-3869e8bbde66"}]}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:05.826906 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.network.neutron [None req-2d2abdb5-2780-44db-ba80-71fcb4bb2649 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] validate_networks() for [('3f69f0bf-630e-493a-a010-3869e8bbde66', None, None, None, None, None)] {{(pid=114106) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 19 08:28:06.270855 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-2d2abdb5-2780-44db-ba80-71fcb4bb2649 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Flavor limits 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 08:28:06.271436 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-2d2abdb5-2780-44db-ba80-71fcb4bb2649 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Image limits 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 08:28:06.271796 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-2d2abdb5-2780-44db-ba80-71fcb4bb2649 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Flavor pref 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 08:28:06.272196 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-2d2abdb5-2780-44db-ba80-71fcb4bb2649 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Image pref 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 08:28:06.272591 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-2d2abdb5-2780-44db-ba80-71fcb4bb2649 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 08:28:06.281597 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2d2abdb5-2780-44db-ba80-71fcb4bb2649 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:06.282030 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2d2abdb5-2780-44db-ba80-71fcb4bb2649 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:06.282840 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2d2abdb5-2780-44db-ba80-71fcb4bb2649 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:06.283258 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2d2abdb5-2780-44db-ba80-71fcb4bb2649 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:06.299820 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-2d2abdb5-2780-44db-ba80-71fcb4bb2649 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Getting quotas for project f570556a465841b98162222c60bef779. Resources: {'cores', 'instances', 'ram'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:28:06.303669 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-2d2abdb5-2780-44db-ba80-71fcb4bb2649 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Getting quotas for user 92073952d8b34c159885daa7d0da3061 and project f570556a465841b98162222c60bef779. Resources: {'cores', 'instances', 'ram'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:28:06.314095 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-2d2abdb5-2780-44db-ba80-71fcb4bb2649 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Going to run 1 instances... {{(pid=114106) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 19 08:28:06.317052 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-2d2abdb5-2780-44db-ba80-71fcb4bb2649 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: ee918319-a52e-42ad-be1f-026c3f704860] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9102a998-a580-4b4e-b6a1-3172273dd66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114106) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 19 08:28:06.364440 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-2d2abdb5-2780-44db-ba80-71fcb4bb2649 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593645 Oct 19 08:28:06.365315 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 383/759] 10.222.0.26 () {60 vars in 1146 bytes} [Tue Oct 19 08:28:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 08:28:06.374977 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-6f387576-bcc7-4a6f-a8d8-ce8d506b4529 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:06.375793 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-6f387576-bcc7-4a6f-a8d8-ce8d506b4529 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: ee918319-a52e-42ad-be1f-026c3f704860] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:06.471047 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-6f387576-bcc7-4a6f-a8d8-ce8d506b4529 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:06.478970 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-6f387576-bcc7-4a6f-a8d8-ce8d506b4529 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860" status: 200 len: 1218 microversion: 2.1 time: 0.107628 Oct 19 08:28:06.479554 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 377/760] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:06 2021] GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860 => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:06.574146 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ea30aa60-33f1-4a1b-b3b7-9fdea59c8466 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:06.575476 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ea30aa60-33f1-4a1b-b3b7-9fdea59c8466 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:06.580087 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-411a1bac-a14d-405b-a4eb-0f1f99ab4fe9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:06.581402 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-411a1bac-a14d-405b-a4eb-0f1f99ab4fe9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:06.583539 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ea30aa60-33f1-4a1b-b3b7-9fdea59c8466 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:06.584053 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ea30aa60-33f1-4a1b-b3b7-9fdea59c8466 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:06.584955 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ea30aa60-33f1-4a1b-b3b7-9fdea59c8466 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:06.585449 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ea30aa60-33f1-4a1b-b3b7-9fdea59c8466 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:06.604181 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-411a1bac-a14d-405b-a4eb-0f1f99ab4fe9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:06.604774 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-411a1bac-a14d-405b-a4eb-0f1f99ab4fe9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:06.605669 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-411a1bac-a14d-405b-a4eb-0f1f99ab4fe9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:06.606301 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-411a1bac-a14d-405b-a4eb-0f1f99ab4fe9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:06.676485 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ea30aa60-33f1-4a1b-b3b7-9fdea59c8466 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.105918 Oct 19 08:28:06.677631 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 384/761] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:28:06 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:28:06.679905 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-411a1bac-a14d-405b-a4eb-0f1f99ab4fe9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.103198 Oct 19 08:28:06.683696 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 378/762] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:28:06 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:28:06.685315 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-3f61deb5-0384-4865-bb48-7ad084f7bd7c req-2008e68e-434a-4f85-9fec-a0fcae546ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b35fc67b-52d9-4e8f-a8a5-27826b508f1b", "name": "network-vif-deleted", "tag": "e2b9fad3-3c12-4fab-ad0c-19ed2c6d2451"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:06.686755 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:28:06.686755 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:28:06.695429 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-3f61deb5-0384-4865-bb48-7ad084f7bd7c req-2008e68e-434a-4f85-9fec-a0fcae546ca5 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:06.696389 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-3f61deb5-0384-4865-bb48-7ad084f7bd7c req-2008e68e-434a-4f85-9fec-a0fcae546ca5 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:06.709275 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-3f61deb5-0384-4865-bb48-7ad084f7bd7c req-2008e68e-434a-4f85-9fec-a0fcae546ca5 service nova] Creating event network-vif-deleted:e2b9fad3-3c12-4fab-ad0c-19ed2c6d2451 for instance b35fc67b-52d9-4e8f-a8a5-27826b508f1b on hv-cinder-81398 Oct 19 08:28:06.714066 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-3f61deb5-0384-4865-bb48-7ad084f7bd7c req-2008e68e-434a-4f85-9fec-a0fcae546ca5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035106 Oct 19 08:28:06.715360 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 385/763] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:28:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:28:06.786753 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-5160e7ee-e0e4-418e-8c6e-b72c6cac1f4d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:06.787655 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-5160e7ee-e0e4-418e-8c6e-b72c6cac1f4d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:06.792081 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b3917f51-0967-480e-9eda-c5244099f039 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:06.792949 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b3917f51-0967-480e-9eda-c5244099f039 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:06.801089 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b3917f51-0967-480e-9eda-c5244099f039 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:06.801615 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b3917f51-0967-480e-9eda-c5244099f039 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:06.802460 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b3917f51-0967-480e-9eda-c5244099f039 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:06.803046 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b3917f51-0967-480e-9eda-c5244099f039 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:06.803834 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5160e7ee-e0e4-418e-8c6e-b72c6cac1f4d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:06.804285 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5160e7ee-e0e4-418e-8c6e-b72c6cac1f4d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:06.805051 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5160e7ee-e0e4-418e-8c6e-b72c6cac1f4d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:06.805606 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5160e7ee-e0e4-418e-8c6e-b72c6cac1f4d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:06.837902 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b3917f51-0967-480e-9eda-c5244099f039 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:06.838771 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b3917f51-0967-480e-9eda-c5244099f039 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:06.839443 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.objects.instance [None req-b3917f51-0967-480e-9eda-c5244099f039 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lazy-loading 'fault' on Instance uuid b35fc67b-52d9-4e8f-a8a5-27826b508f1b {{(pid=114106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 19 08:28:06.893123 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-b3917f51-0967-480e-9eda-c5244099f039 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:06.900614 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b3917f51-0967-480e-9eda-c5244099f039 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 200 len: 1307 microversion: 2.1 time: 0.113765 Oct 19 08:28:06.903871 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 386/764] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:06 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 1307 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:06.974838 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-5160e7ee-e0e4-418e-8c6e-b72c6cac1f4d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:06.984090 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-5160e7ee-e0e4-418e-8c6e-b72c6cac1f4d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1567 microversion: 2.1 time: 0.201322 Oct 19 08:28:06.984812 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 379/765] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:06 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1567 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:07.495526 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-6c1bb552-892c-4e40-b98f-1abb51478984 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:07.496125 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-6c1bb552-892c-4e40-b98f-1abb51478984 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: ee918319-a52e-42ad-be1f-026c3f704860] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:07.501987 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6c1bb552-892c-4e40-b98f-1abb51478984 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:07.502423 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6c1bb552-892c-4e40-b98f-1abb51478984 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:07.503861 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6c1bb552-892c-4e40-b98f-1abb51478984 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:07.504369 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6c1bb552-892c-4e40-b98f-1abb51478984 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:07.562252 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-6c1bb552-892c-4e40-b98f-1abb51478984 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:07.569972 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-6c1bb552-892c-4e40-b98f-1abb51478984 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860" status: 200 len: 1270 microversion: 2.1 time: 0.078123 Oct 19 08:28:07.570533 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 387/766] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:07 2021] GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860 => generated 1270 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:07.687990 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d955bc56-5787-4cd1-b693-e991b383e6bf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:07.688898 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-d955bc56-5787-4cd1-b693-e991b383e6bf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:07.690854 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a598dc61-4b16-4a0e-9177-88425f07b9be tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:07.691757 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a598dc61-4b16-4a0e-9177-88425f07b9be tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:07.695095 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d955bc56-5787-4cd1-b693-e991b383e6bf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:07.695547 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d955bc56-5787-4cd1-b693-e991b383e6bf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:07.696316 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d955bc56-5787-4cd1-b693-e991b383e6bf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:07.696778 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d955bc56-5787-4cd1-b693-e991b383e6bf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:07.697790 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a598dc61-4b16-4a0e-9177-88425f07b9be tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:07.698230 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a598dc61-4b16-4a0e-9177-88425f07b9be tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:07.699031 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a598dc61-4b16-4a0e-9177-88425f07b9be tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:07.699453 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a598dc61-4b16-4a0e-9177-88425f07b9be tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:07.796780 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-d955bc56-5787-4cd1-b693-e991b383e6bf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.112417 Oct 19 08:28:07.801420 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 380/767] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:28:07 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:28:07.806075 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a598dc61-4b16-4a0e-9177-88425f07b9be tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.118504 Oct 19 08:28:07.809917 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 388/768] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:28:07 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:28:07.919302 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-9f9b93bf-9cad-4a4f-bc37-78d72fa2e3f2 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:07.920029 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-9f9b93bf-9cad-4a4f-bc37-78d72fa2e3f2 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b35fc67b-52d9-4e8f-a8a5-27826b508f1b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:07.927400 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9f9b93bf-9cad-4a4f-bc37-78d72fa2e3f2 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:07.927845 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9f9b93bf-9cad-4a4f-bc37-78d72fa2e3f2 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:07.928614 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9f9b93bf-9cad-4a4f-bc37-78d72fa2e3f2 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:07.929093 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9f9b93bf-9cad-4a4f-bc37-78d72fa2e3f2 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:07.944435 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.wsgi [None req-9f9b93bf-9cad-4a4f-bc37-78d72fa2e3f2 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] HTTP exception thrown: Instance b35fc67b-52d9-4e8f-a8a5-27826b508f1b could not be found. Oct 19 08:28:07.945001 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-9f9b93bf-9cad-4a4f-bc37-78d72fa2e3f2 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Returning 404 to user: Instance b35fc67b-52d9-4e8f-a8a5-27826b508f1b could not be found. {{(pid=114105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:28:07.945821 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-9f9b93bf-9cad-4a4f-bc37-78d72fa2e3f2 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b" status: 404 len: 111 microversion: 2.1 time: 0.030460 Oct 19 08:28:07.946573 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 381/769] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:07 2021] GET /compute/v2.1/servers/b35fc67b-52d9-4e8f-a8a5-27826b508f1b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:28:07.954844 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-841ee22b-7466-4fbd-b942-b473ad35e018 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:07.955419 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-841ee22b-7466-4fbd-b942-b473ad35e018 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 4bd61122-7096-461a-95b1-adc1dea18a0c] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:07.961837 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-841ee22b-7466-4fbd-b942-b473ad35e018 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:07.962476 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-841ee22b-7466-4fbd-b942-b473ad35e018 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:07.963427 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-841ee22b-7466-4fbd-b942-b473ad35e018 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:07.964018 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-841ee22b-7466-4fbd-b942-b473ad35e018 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:07.990293 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-841ee22b-7466-4fbd-b942-b473ad35e018 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 4bd61122-7096-461a-95b1-adc1dea18a0c] Going to try to terminate instance {{(pid=114106) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 19 08:28:08.000931 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-ec02b874-202e-4662-b44e-a77f5d600743 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:08.001535 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-ec02b874-202e-4662-b44e-a77f5d600743 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:08.007676 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ec02b874-202e-4662-b44e-a77f5d600743 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:08.008120 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ec02b874-202e-4662-b44e-a77f5d600743 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:08.008872 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ec02b874-202e-4662-b44e-a77f5d600743 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:08.009301 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ec02b874-202e-4662-b44e-a77f5d600743 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:08.066056 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-841ee22b-7466-4fbd-b942-b473ad35e018 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c" status: 204 len: 0 microversion: 2.1 time: 0.114809 Oct 19 08:28:08.066693 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 389/770] 10.222.0.26 () {58 vars in 1238 bytes} [Tue Oct 19 08:28:07 2021] DELETE /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 08:28:08.074714 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a8b8ba70-2e7c-40a8-85c6-c904e7e16480 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:08.075400 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a8b8ba70-2e7c-40a8-85c6-c904e7e16480 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 4bd61122-7096-461a-95b1-adc1dea18a0c] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:08.081705 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a8b8ba70-2e7c-40a8-85c6-c904e7e16480 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:08.082550 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a8b8ba70-2e7c-40a8-85c6-c904e7e16480 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:08.083480 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a8b8ba70-2e7c-40a8-85c6-c904e7e16480 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:08.083988 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a8b8ba70-2e7c-40a8-85c6-c904e7e16480 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:08.155288 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-ec02b874-202e-4662-b44e-a77f5d600743 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:08.163690 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-ec02b874-202e-4662-b44e-a77f5d600743 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1547 microversion: 2.1 time: 0.166445 Oct 19 08:28:08.164242 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 382/771] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:07 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1547 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:28:08.180019 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-ca0a80cf-4d53-4998-8a65-41c23900849d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:08.180521 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-ca0a80cf-4d53-4998-8a65-41c23900849d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:08.186331 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ca0a80cf-4d53-4998-8a65-41c23900849d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:08.186827 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ca0a80cf-4d53-4998-8a65-41c23900849d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:08.187592 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ca0a80cf-4d53-4998-8a65-41c23900849d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:08.188069 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ca0a80cf-4d53-4998-8a65-41c23900849d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:08.216316 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a8b8ba70-2e7c-40a8-85c6-c904e7e16480 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:08.225281 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a8b8ba70-2e7c-40a8-85c6-c904e7e16480 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c" status: 200 len: 1514 microversion: 2.1 time: 0.154349 Oct 19 08:28:08.225929 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 390/772] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:08 2021] GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:28:08.265314 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.wsgi [None req-ca0a80cf-4d53-4998-8a65-41c23900849d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] HTTP exception thrown: Cannot 'detach_volume' instance a2a856f6-f552-461f-8d9c-4bf017cbbac5 while it is in vm_state rescued Oct 19 08:28:08.265902 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-ca0a80cf-4d53-4998-8a65-41c23900849d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Returning 409 to user: Cannot 'detach_volume' instance a2a856f6-f552-461f-8d9c-4bf017cbbac5 while it is in vm_state rescued {{(pid=114105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:28:08.266766 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-ca0a80cf-4d53-4998-8a65-41c23900849d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5/os-volume_attachments/2bdd5a60-577c-4198-832c-a98b07308b49" status: 409 len: 152 microversion: 2.1 time: 0.090546 Oct 19 08:28:08.267294 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 383/773] 10.222.0.26 () {58 vars in 1415 bytes} [Tue Oct 19 08:28:08 2021] DELETE /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5/os-volume_attachments/2bdd5a60-577c-4198-832c-a98b07308b49 => generated 152 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 19 08:28:08.276033 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-086c457e-eb71-4109-a1ba-be810aa1219b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:08.276552 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-086c457e-eb71-4109-a1ba-be810aa1219b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:08.282162 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-086c457e-eb71-4109-a1ba-be810aa1219b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:08.282706 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-086c457e-eb71-4109-a1ba-be810aa1219b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:08.283446 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-086c457e-eb71-4109-a1ba-be810aa1219b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:08.283863 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-086c457e-eb71-4109-a1ba-be810aa1219b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:08.347554 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-086c457e-eb71-4109-a1ba-be810aa1219b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "POST /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5/action" status: 202 len: 0 microversion: 2.1 time: 0.074227 Oct 19 08:28:08.348160 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 391/774] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:28:08 2021] POST /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:28:08.356006 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-6a72ad16-7fbb-4ff6-85f7-4235756d850a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:08.356611 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-6a72ad16-7fbb-4ff6-85f7-4235756d850a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:08.362390 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6a72ad16-7fbb-4ff6-85f7-4235756d850a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:08.362872 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6a72ad16-7fbb-4ff6-85f7-4235756d850a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:08.363630 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6a72ad16-7fbb-4ff6-85f7-4235756d850a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:08.364171 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6a72ad16-7fbb-4ff6-85f7-4235756d850a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:08.485564 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-6a72ad16-7fbb-4ff6-85f7-4235756d850a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:08.493159 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-6a72ad16-7fbb-4ff6-85f7-4235756d850a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1555 microversion: 2.1 time: 0.140766 Oct 19 08:28:08.493703 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 384/775] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:08 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1555 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:08.587454 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-aa2bb98f-5215-48d0-910a-0232ecff5f96 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:08.588137 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-aa2bb98f-5215-48d0-910a-0232ecff5f96 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: ee918319-a52e-42ad-be1f-026c3f704860] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:08.593927 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-aa2bb98f-5215-48d0-910a-0232ecff5f96 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:08.594360 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-aa2bb98f-5215-48d0-910a-0232ecff5f96 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:08.595136 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-aa2bb98f-5215-48d0-910a-0232ecff5f96 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:08.595557 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-aa2bb98f-5215-48d0-910a-0232ecff5f96 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:08.656077 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-aa2bb98f-5215-48d0-910a-0232ecff5f96 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:08.663163 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-aa2bb98f-5215-48d0-910a-0232ecff5f96 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860" status: 200 len: 1276 microversion: 2.1 time: 0.079601 Oct 19 08:28:08.663725 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 392/776] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:08 2021] GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860 => generated 1276 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:08.808957 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-b7052fc0-257e-4815-83a5-e1c80080df23 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:08.809792 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-b7052fc0-257e-4815-83a5-e1c80080df23 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:08.818233 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b7052fc0-257e-4815-83a5-e1c80080df23 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:08.818425 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-8dec819b-27dc-453f-bc6b-7b129022a85c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:08.818715 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b7052fc0-257e-4815-83a5-e1c80080df23 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:08.819159 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-8dec819b-27dc-453f-bc6b-7b129022a85c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:08.819482 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b7052fc0-257e-4815-83a5-e1c80080df23 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:08.819916 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b7052fc0-257e-4815-83a5-e1c80080df23 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:08.824733 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8dec819b-27dc-453f-bc6b-7b129022a85c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:08.825174 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8dec819b-27dc-453f-bc6b-7b129022a85c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:08.825961 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8dec819b-27dc-453f-bc6b-7b129022a85c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:08.826388 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8dec819b-27dc-453f-bc6b-7b129022a85c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:12.749186 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-8dec819b-27dc-453f-bc6b-7b129022a85c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 3.935603 Oct 19 08:28:12.754072 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 393/777] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:28:08 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 3938 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:28:12.756353 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-b7052fc0-257e-4815-83a5-e1c80080df23 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 3.950964 Oct 19 08:28:12.757049 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a777a10e-c669-41f7-996b-87138b2bb11e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:12.758357 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a777a10e-c669-41f7-996b-87138b2bb11e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 4bd61122-7096-461a-95b1-adc1dea18a0c] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:12.761076 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 385/778] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:28:08 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 3956 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:28:12.764150 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a777a10e-c669-41f7-996b-87138b2bb11e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:12.764591 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a777a10e-c669-41f7-996b-87138b2bb11e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:12.765350 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a777a10e-c669-41f7-996b-87138b2bb11e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:12.765791 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a777a10e-c669-41f7-996b-87138b2bb11e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:12.770415 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2c4e3946-c803-406f-842a-8cdee51a4c8c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:12.770415 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2c4e3946-c803-406f-842a-8cdee51a4c8c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:12.776806 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2c4e3946-c803-406f-842a-8cdee51a4c8c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:12.777253 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2c4e3946-c803-406f-842a-8cdee51a4c8c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:12.778023 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2c4e3946-c803-406f-842a-8cdee51a4c8c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:12.778444 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2c4e3946-c803-406f-842a-8cdee51a4c8c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:13.148139 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a777a10e-c669-41f7-996b-87138b2bb11e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:13.155558 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a777a10e-c669-41f7-996b-87138b2bb11e tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c" status: 200 len: 1514 microversion: 2.1 time: 0.403252 Oct 19 08:28:13.156177 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 394/779] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:12 2021] GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c => generated 1514 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:13.161445 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-9e6eee68-b315-46ff-a810-46940b5e6ae1 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:13.162049 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-9e6eee68-b315-46ff-a810-46940b5e6ae1 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: ee918319-a52e-42ad-be1f-026c3f704860] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:13.164357 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-2c4e3946-c803-406f-842a-8cdee51a4c8c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:13.171101 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9e6eee68-b315-46ff-a810-46940b5e6ae1 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:13.171509 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9e6eee68-b315-46ff-a810-46940b5e6ae1 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:13.172537 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9e6eee68-b315-46ff-a810-46940b5e6ae1 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:13.172671 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2c4e3946-c803-406f-842a-8cdee51a4c8c tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1555 microversion: 2.1 time: 0.410318 Oct 19 08:28:13.172901 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9e6eee68-b315-46ff-a810-46940b5e6ae1 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:13.173269 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 386/780] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:12 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1555 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:13.486136 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-9e6eee68-b315-46ff-a810-46940b5e6ae1 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:13.493294 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-9e6eee68-b315-46ff-a810-46940b5e6ae1 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860" status: 200 len: 1318 microversion: 2.1 time: 0.336159 Oct 19 08:28:13.493847 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 395/781] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:13 2021] GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860 => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:13.761290 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-4058d19f-3bb2-4622-abbf-175a28a7dccd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:13.762204 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-4058d19f-3bb2-4622-abbf-175a28a7dccd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:13.768409 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ec239990-c925-4be0-805c-1082fd5a2c51 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:13.769444 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4058d19f-3bb2-4622-abbf-175a28a7dccd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:13.769845 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ec239990-c925-4be0-805c-1082fd5a2c51 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:13.770001 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4058d19f-3bb2-4622-abbf-175a28a7dccd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:13.770652 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4058d19f-3bb2-4622-abbf-175a28a7dccd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:13.771086 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4058d19f-3bb2-4622-abbf-175a28a7dccd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:13.776336 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ec239990-c925-4be0-805c-1082fd5a2c51 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:13.776809 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ec239990-c925-4be0-805c-1082fd5a2c51 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:13.777607 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ec239990-c925-4be0-805c-1082fd5a2c51 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:13.778196 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ec239990-c925-4be0-805c-1082fd5a2c51 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:13.880480 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ec239990-c925-4be0-805c-1082fd5a2c51 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.115781 Oct 19 08:28:13.884911 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 396/782] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:28:13 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:28:13.887494 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-9217603d-030a-43f9-920d-412885e7c586 req-d12038a6-30aa-4885-b2c4-ee3b6b0c89cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee918319-a52e-42ad-be1f-026c3f704860", "tag": "f15e40d0-7913-4978-b0ff-8bd4d2ded1ec"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:13.889044 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:28:13.889044 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:28:13.896681 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-9217603d-030a-43f9-920d-412885e7c586 req-d12038a6-30aa-4885-b2c4-ee3b6b0c89cb service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:13.897112 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-9217603d-030a-43f9-920d-412885e7c586 req-d12038a6-30aa-4885-b2c4-ee3b6b0c89cb service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:13.907577 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-9217603d-030a-43f9-920d-412885e7c586 req-d12038a6-30aa-4885-b2c4-ee3b6b0c89cb service nova] Creating event network-changed:f15e40d0-7913-4978-b0ff-8bd4d2ded1ec for instance ee918319-a52e-42ad-be1f-026c3f704860 on hv-cinder-81398 Oct 19 08:28:13.912706 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-9217603d-030a-43f9-920d-412885e7c586 req-d12038a6-30aa-4885-b2c4-ee3b6b0c89cb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029528 Oct 19 08:28:13.913270 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 397/783] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:28:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:28:13.919544 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-4058d19f-3bb2-4622-abbf-175a28a7dccd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.161728 Oct 19 08:28:13.920210 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 387/784] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:28:13 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:28:14.173300 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-0663f692-d852-46ea-bc2b-de78f5e1f9fe tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:14.173988 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-0663f692-d852-46ea-bc2b-de78f5e1f9fe tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 4bd61122-7096-461a-95b1-adc1dea18a0c] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:14.180287 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0663f692-d852-46ea-bc2b-de78f5e1f9fe tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:14.180729 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0663f692-d852-46ea-bc2b-de78f5e1f9fe tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:14.181481 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0663f692-d852-46ea-bc2b-de78f5e1f9fe tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:14.181900 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0663f692-d852-46ea-bc2b-de78f5e1f9fe tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:14.193402 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-1e75d750-bde6-423d-b5fd-e7af6957e682 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:14.194089 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-1e75d750-bde6-423d-b5fd-e7af6957e682 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:14.210722 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1e75d750-bde6-423d-b5fd-e7af6957e682 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:14.211166 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1e75d750-bde6-423d-b5fd-e7af6957e682 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:14.211992 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1e75d750-bde6-423d-b5fd-e7af6957e682 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:14.212417 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1e75d750-bde6-423d-b5fd-e7af6957e682 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:14.424396 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-0663f692-d852-46ea-bc2b-de78f5e1f9fe tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:14.432462 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-0663f692-d852-46ea-bc2b-de78f5e1f9fe tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c" status: 200 len: 1514 microversion: 2.1 time: 0.263126 Oct 19 08:28:14.433036 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 398/785] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:14 2021] GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c => generated 1514 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:14.453014 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-1e75d750-bde6-423d-b5fd-e7af6957e682 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:14.461012 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-1e75d750-bde6-423d-b5fd-e7af6957e682 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1555 microversion: 2.1 time: 0.272622 Oct 19 08:28:14.461567 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 388/786] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:14 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1555 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:28:14.509470 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3339b1ab-234f-4204-adff-e3846c7a0ebf tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:14.510101 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3339b1ab-234f-4204-adff-e3846c7a0ebf tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: ee918319-a52e-42ad-be1f-026c3f704860] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:14.515740 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3339b1ab-234f-4204-adff-e3846c7a0ebf tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:14.516183 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3339b1ab-234f-4204-adff-e3846c7a0ebf tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:14.516934 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3339b1ab-234f-4204-adff-e3846c7a0ebf tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:14.517363 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3339b1ab-234f-4204-adff-e3846c7a0ebf tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:14.710936 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3339b1ab-234f-4204-adff-e3846c7a0ebf tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:14.718131 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3339b1ab-234f-4204-adff-e3846c7a0ebf tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860" status: 200 len: 1318 microversion: 2.1 time: 0.212734 Oct 19 08:28:14.718718 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 399/787] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:14 2021] GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:14.892404 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d4ce1216-4638-43d8-a05e-bb302447886c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:14.893381 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-d4ce1216-4638-43d8-a05e-bb302447886c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:14.899817 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d4ce1216-4638-43d8-a05e-bb302447886c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:14.900200 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d4ce1216-4638-43d8-a05e-bb302447886c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:14.900958 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d4ce1216-4638-43d8-a05e-bb302447886c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:14.901390 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d4ce1216-4638-43d8-a05e-bb302447886c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:14.930805 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-f5e0693e-d5e7-4446-8b5a-815fb63950eb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:14.931697 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-f5e0693e-d5e7-4446-8b5a-815fb63950eb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:14.937710 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f5e0693e-d5e7-4446-8b5a-815fb63950eb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:14.938141 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f5e0693e-d5e7-4446-8b5a-815fb63950eb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:14.938928 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f5e0693e-d5e7-4446-8b5a-815fb63950eb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:14.939344 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f5e0693e-d5e7-4446-8b5a-815fb63950eb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:15.419440 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-d4ce1216-4638-43d8-a05e-bb302447886c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 28670 microversion: 2.20 time: 0.530540 Oct 19 08:28:15.420077 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 389/788] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:28:14 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 28670 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:28:15.431849 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-f5e0693e-d5e7-4446-8b5a-815fb63950eb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.504438 Oct 19 08:28:15.432474 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 400/789] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:28:14 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:28:15.448984 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-54181494-3f38-427b-952e-a2e76dd61274 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:15.449667 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-54181494-3f38-427b-952e-a2e76dd61274 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 4bd61122-7096-461a-95b1-adc1dea18a0c] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:15.456082 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-54181494-3f38-427b-952e-a2e76dd61274 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:15.456524 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-54181494-3f38-427b-952e-a2e76dd61274 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:15.457925 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-54181494-3f38-427b-952e-a2e76dd61274 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:15.458437 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-54181494-3f38-427b-952e-a2e76dd61274 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:15.478260 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-833971a2-faa4-4cdf-bf8c-d6594c87cacf tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:15.478969 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-833971a2-faa4-4cdf-bf8c-d6594c87cacf tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:15.485194 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-833971a2-faa4-4cdf-bf8c-d6594c87cacf tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:15.485628 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-833971a2-faa4-4cdf-bf8c-d6594c87cacf tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:15.486371 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-833971a2-faa4-4cdf-bf8c-d6594c87cacf tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:15.486821 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-833971a2-faa4-4cdf-bf8c-d6594c87cacf tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:15.639861 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-54181494-3f38-427b-952e-a2e76dd61274 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:15.644392 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-833971a2-faa4-4cdf-bf8c-d6594c87cacf tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:15.647148 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-54181494-3f38-427b-952e-a2e76dd61274 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c" status: 200 len: 1514 microversion: 2.1 time: 0.201936 Oct 19 08:28:15.647718 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 390/790] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:15 2021] GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c => generated 1514 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:15.652434 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-833971a2-faa4-4cdf-bf8c-d6594c87cacf tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1555 microversion: 2.1 time: 0.178019 Oct 19 08:28:15.652972 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 401/791] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:15 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1555 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:15.735016 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-36ce0ea1-e6f4-4bbf-9d74-d3e753fa8673 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:15.735609 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-36ce0ea1-e6f4-4bbf-9d74-d3e753fa8673 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: ee918319-a52e-42ad-be1f-026c3f704860] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:15.741985 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-36ce0ea1-e6f4-4bbf-9d74-d3e753fa8673 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:15.742423 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-36ce0ea1-e6f4-4bbf-9d74-d3e753fa8673 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:15.743196 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-36ce0ea1-e6f4-4bbf-9d74-d3e753fa8673 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:15.743615 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-36ce0ea1-e6f4-4bbf-9d74-d3e753fa8673 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:15.922679 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-36ce0ea1-e6f4-4bbf-9d74-d3e753fa8673 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:15.930798 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-36ce0ea1-e6f4-4bbf-9d74-d3e753fa8673 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860" status: 200 len: 1318 microversion: 2.1 time: 0.199213 Oct 19 08:28:15.931362 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 391/792] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:15 2021] GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:16.286657 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-93e49585-c1bc-4fb2-ac42-5c5eff257374 req-51c277e8-37d9-4aa5-a38a-3e69f55ea579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bd61122-7096-461a-95b1-adc1dea18a0c", "name": "network-vif-deleted", "tag": "6a155696-ac5e-466f-9258-1a6e5fa773b5"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:16.288423 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:28:16.288423 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:28:16.296203 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-93e49585-c1bc-4fb2-ac42-5c5eff257374 req-51c277e8-37d9-4aa5-a38a-3e69f55ea579 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:16.296732 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-93e49585-c1bc-4fb2-ac42-5c5eff257374 req-51c277e8-37d9-4aa5-a38a-3e69f55ea579 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:16.311530 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-93e49585-c1bc-4fb2-ac42-5c5eff257374 req-51c277e8-37d9-4aa5-a38a-3e69f55ea579 service nova] Creating event network-vif-deleted:6a155696-ac5e-466f-9258-1a6e5fa773b5 for instance 4bd61122-7096-461a-95b1-adc1dea18a0c on hv-cinder-81398 Oct 19 08:28:16.316856 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-93e49585-c1bc-4fb2-ac42-5c5eff257374 req-51c277e8-37d9-4aa5-a38a-3e69f55ea579 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035406 Oct 19 08:28:16.317631 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 402/793] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:28:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:28:16.431418 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-0b8e5fe4-7e07-4a48-bd4c-d8f246f000a3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:16.432367 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-0b8e5fe4-7e07-4a48-bd4c-d8f246f000a3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:16.438107 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0b8e5fe4-7e07-4a48-bd4c-d8f246f000a3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:16.438577 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0b8e5fe4-7e07-4a48-bd4c-d8f246f000a3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:16.439329 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0b8e5fe4-7e07-4a48-bd4c-d8f246f000a3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:16.439753 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0b8e5fe4-7e07-4a48-bd4c-d8f246f000a3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:16.444079 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-1c90de05-0975-4692-b0c7-36eb85fe3193 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:16.445440 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-1c90de05-0975-4692-b0c7-36eb85fe3193 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:16.454427 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1c90de05-0975-4692-b0c7-36eb85fe3193 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:16.454832 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1c90de05-0975-4692-b0c7-36eb85fe3193 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:16.455599 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1c90de05-0975-4692-b0c7-36eb85fe3193 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:16.456028 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1c90de05-0975-4692-b0c7-36eb85fe3193 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:16.540981 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-0b8e5fe4-7e07-4a48-bd4c-d8f246f000a3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 29592 microversion: 2.20 time: 0.113367 Oct 19 08:28:16.541864 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 392/794] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:28:16 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 29592 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:28:16.552007 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-1c90de05-0975-4692-b0c7-36eb85fe3193 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.112581 Oct 19 08:28:16.552604 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 403/795] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:28:16 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:28:16.664305 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-abc11c5f-86da-4239-9629-0e053f7ddaee tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:16.664990 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-abc11c5f-86da-4239-9629-0e053f7ddaee tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 4bd61122-7096-461a-95b1-adc1dea18a0c] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:16.669277 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-9e9e4270-eda1-44e8-8563-3d89a2784870 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:16.669963 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-9e9e4270-eda1-44e8-8563-3d89a2784870 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:16.671480 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-abc11c5f-86da-4239-9629-0e053f7ddaee tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:16.671925 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-abc11c5f-86da-4239-9629-0e053f7ddaee tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:16.672685 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-abc11c5f-86da-4239-9629-0e053f7ddaee tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:16.673113 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-abc11c5f-86da-4239-9629-0e053f7ddaee tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:16.676241 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9e9e4270-eda1-44e8-8563-3d89a2784870 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:16.678010 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9e9e4270-eda1-44e8-8563-3d89a2784870 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:16.678010 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9e9e4270-eda1-44e8-8563-3d89a2784870 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:16.678010 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9e9e4270-eda1-44e8-8563-3d89a2784870 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:16.704143 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-abc11c5f-86da-4239-9629-0e053f7ddaee tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:16.704636 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-abc11c5f-86da-4239-9629-0e053f7ddaee tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:16.705019 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.objects.instance [None req-abc11c5f-86da-4239-9629-0e053f7ddaee tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lazy-loading 'fault' on Instance uuid 4bd61122-7096-461a-95b1-adc1dea18a0c {{(pid=114105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 19 08:28:16.760580 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-abc11c5f-86da-4239-9629-0e053f7ddaee tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:16.768371 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-abc11c5f-86da-4239-9629-0e053f7ddaee tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c" status: 200 len: 1308 microversion: 2.1 time: 0.107587 Oct 19 08:28:16.768500 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 393/796] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:16 2021] GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:16.822587 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-9e9e4270-eda1-44e8-8563-3d89a2784870 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:16.830401 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-9e9e4270-eda1-44e8-8563-3d89a2784870 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1555 microversion: 2.1 time: 0.165068 Oct 19 08:28:16.831010 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 404/797] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:16 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:28:16.948819 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-24d3a77b-96e9-4bc6-96da-758cbaf89546 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:16.949682 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-24d3a77b-96e9-4bc6-96da-758cbaf89546 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: ee918319-a52e-42ad-be1f-026c3f704860] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:16.956886 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-24d3a77b-96e9-4bc6-96da-758cbaf89546 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:16.957460 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-24d3a77b-96e9-4bc6-96da-758cbaf89546 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:16.958437 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-24d3a77b-96e9-4bc6-96da-758cbaf89546 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:16.958887 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-24d3a77b-96e9-4bc6-96da-758cbaf89546 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:17.077972 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-24d3a77b-96e9-4bc6-96da-758cbaf89546 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:17.085608 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-24d3a77b-96e9-4bc6-96da-758cbaf89546 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860" status: 200 len: 1318 microversion: 2.1 time: 0.141549 Oct 19 08:28:17.086144 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 394/798] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:16 2021] GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860 => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:17.552619 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-4c4d401d-c9b3-4811-84a9-2901eeaf2c9d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:17.553523 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-4c4d401d-c9b3-4811-84a9-2901eeaf2c9d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:17.559354 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4c4d401d-c9b3-4811-84a9-2901eeaf2c9d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:17.559793 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4c4d401d-c9b3-4811-84a9-2901eeaf2c9d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:17.560573 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4c4d401d-c9b3-4811-84a9-2901eeaf2c9d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:17.561006 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4c4d401d-c9b3-4811-84a9-2901eeaf2c9d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:17.563315 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-a7322699-07c6-4c48-a54b-f2117c5c24a7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:17.564225 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-a7322699-07c6-4c48-a54b-f2117c5c24a7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:17.570679 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a7322699-07c6-4c48-a54b-f2117c5c24a7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:17.571133 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a7322699-07c6-4c48-a54b-f2117c5c24a7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:17.571901 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a7322699-07c6-4c48-a54b-f2117c5c24a7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:17.572330 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a7322699-07c6-4c48-a54b-f2117c5c24a7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:17.663557 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-a7322699-07c6-4c48-a54b-f2117c5c24a7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.103751 Oct 19 08:28:17.664575 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 395/799] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:28:17 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:28:17.682207 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-4c4d401d-c9b3-4811-84a9-2901eeaf2c9d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 31292 microversion: 2.20 time: 0.133190 Oct 19 08:28:17.682875 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 405/800] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:28:17 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 31292 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:28:17.785320 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-01870384-6c23-41d6-93ab-f2dcdb551f6b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:17.786033 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-01870384-6c23-41d6-93ab-f2dcdb551f6b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: 4bd61122-7096-461a-95b1-adc1dea18a0c] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:17.792370 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-01870384-6c23-41d6-93ab-f2dcdb551f6b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:17.792821 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-01870384-6c23-41d6-93ab-f2dcdb551f6b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:17.793577 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-01870384-6c23-41d6-93ab-f2dcdb551f6b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:17.794003 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-01870384-6c23-41d6-93ab-f2dcdb551f6b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:17.807525 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.wsgi [None req-01870384-6c23-41d6-93ab-f2dcdb551f6b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] HTTP exception thrown: Instance 4bd61122-7096-461a-95b1-adc1dea18a0c could not be found. Oct 19 08:28:17.808103 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-01870384-6c23-41d6-93ab-f2dcdb551f6b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Returning 404 to user: Instance 4bd61122-7096-461a-95b1-adc1dea18a0c could not be found. {{(pid=114105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:28:17.808900 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-01870384-6c23-41d6-93ab-f2dcdb551f6b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c" status: 404 len: 111 microversion: 2.1 time: 0.027651 Oct 19 08:28:17.809416 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 396/801] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:17 2021] GET /compute/v2.1/servers/4bd61122-7096-461a-95b1-adc1dea18a0c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:28:17.848970 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b3cc0119-a815-441b-a3e2-c2870cd3e5b4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:17.849828 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b3cc0119-a815-441b-a3e2-c2870cd3e5b4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:17.856654 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b3cc0119-a815-441b-a3e2-c2870cd3e5b4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:17.857172 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b3cc0119-a815-441b-a3e2-c2870cd3e5b4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:17.857970 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b3cc0119-a815-441b-a3e2-c2870cd3e5b4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:17.858563 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b3cc0119-a815-441b-a3e2-c2870cd3e5b4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:18.102813 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-58b9a58e-cfe0-45e0-a639-17200860396b tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:18.103570 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-58b9a58e-cfe0-45e0-a639-17200860396b tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: ee918319-a52e-42ad-be1f-026c3f704860] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:18.109697 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-58b9a58e-cfe0-45e0-a639-17200860396b tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:18.110146 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-58b9a58e-cfe0-45e0-a639-17200860396b tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:18.110955 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-58b9a58e-cfe0-45e0-a639-17200860396b tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:18.111391 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-58b9a58e-cfe0-45e0-a639-17200860396b tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:18.226304 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-b3cc0119-a815-441b-a3e2-c2870cd3e5b4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:18.234110 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b3cc0119-a815-441b-a3e2-c2870cd3e5b4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1555 microversion: 2.1 time: 0.390105 Oct 19 08:28:18.234708 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 406/802] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:17 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1555 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:18.280410 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-58b9a58e-cfe0-45e0-a639-17200860396b tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:18.287756 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-58b9a58e-cfe0-45e0-a639-17200860396b tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860" status: 200 len: 1318 microversion: 2.1 time: 0.188675 Oct 19 08:28:18.288300 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 397/803] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:18 2021] GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:28:18.675139 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-96d31e5a-9cee-49f1-9567-2af4d4f454fb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:18.676551 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-96d31e5a-9cee-49f1-9567-2af4d4f454fb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:18.682366 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-96d31e5a-9cee-49f1-9567-2af4d4f454fb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:18.682866 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-96d31e5a-9cee-49f1-9567-2af4d4f454fb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:18.683609 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-96d31e5a-9cee-49f1-9567-2af4d4f454fb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:18.684030 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-96d31e5a-9cee-49f1-9567-2af4d4f454fb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:18.693988 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d5b4ba4f-ae13-4f77-84bd-d7e644a1dee5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:18.694923 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-d5b4ba4f-ae13-4f77-84bd-d7e644a1dee5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:18.700888 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d5b4ba4f-ae13-4f77-84bd-d7e644a1dee5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:18.701344 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d5b4ba4f-ae13-4f77-84bd-d7e644a1dee5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:18.702111 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d5b4ba4f-ae13-4f77-84bd-d7e644a1dee5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:18.702557 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d5b4ba4f-ae13-4f77-84bd-d7e644a1dee5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:18.924564 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-96d31e5a-9cee-49f1-9567-2af4d4f454fb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28611 microversion: 2.1 time: 0.252855 Oct 19 08:28:18.928303 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 407/804] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:28:18 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28611 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:28:18.978900 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-d5b4ba4f-ae13-4f77-84bd-d7e644a1dee5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 33001 microversion: 2.20 time: 0.288903 Oct 19 08:28:18.979564 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 398/805] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:28:18 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 33001 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:28:19.252255 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ae009831-05b8-414d-bab0-e1c56832a288 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:19.252867 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ae009831-05b8-414d-bab0-e1c56832a288 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:19.259939 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ae009831-05b8-414d-bab0-e1c56832a288 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:19.260388 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ae009831-05b8-414d-bab0-e1c56832a288 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:19.261148 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ae009831-05b8-414d-bab0-e1c56832a288 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:19.261572 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ae009831-05b8-414d-bab0-e1c56832a288 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:19.304894 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-52a18ce0-b00a-47d4-b674-1d5c6a379b57 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:19.305574 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-52a18ce0-b00a-47d4-b674-1d5c6a379b57 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: ee918319-a52e-42ad-be1f-026c3f704860] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:19.311894 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-52a18ce0-b00a-47d4-b674-1d5c6a379b57 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:19.312333 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-52a18ce0-b00a-47d4-b674-1d5c6a379b57 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:19.313151 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-52a18ce0-b00a-47d4-b674-1d5c6a379b57 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:19.313570 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-52a18ce0-b00a-47d4-b674-1d5c6a379b57 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:19.423479 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ae009831-05b8-414d-bab0-e1c56832a288 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:19.431201 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ae009831-05b8-414d-bab0-e1c56832a288 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1555 microversion: 2.1 time: 0.183703 Oct 19 08:28:19.431764 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 408/806] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:19 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1555 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:19.461763 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-52a18ce0-b00a-47d4-b674-1d5c6a379b57 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:19.469328 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-52a18ce0-b00a-47d4-b674-1d5c6a379b57 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860" status: 200 len: 1318 microversion: 2.1 time: 0.168674 Oct 19 08:28:19.469876 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 399/807] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:19 2021] GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:28:19.936253 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-66b48dac-d4d8-4a5f-aee1-e1df2436cf85 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:19.937157 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-66b48dac-d4d8-4a5f-aee1-e1df2436cf85 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:19.943401 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-66b48dac-d4d8-4a5f-aee1-e1df2436cf85 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:19.943839 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-66b48dac-d4d8-4a5f-aee1-e1df2436cf85 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:19.944767 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-66b48dac-d4d8-4a5f-aee1-e1df2436cf85 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:19.945337 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-66b48dac-d4d8-4a5f-aee1-e1df2436cf85 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:19.984586 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-3f9b96e8-5429-4358-904a-560f380ed872 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:19.985198 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-3f9b96e8-5429-4358-904a-560f380ed872 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:19.992887 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3f9b96e8-5429-4358-904a-560f380ed872 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:19.993324 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3f9b96e8-5429-4358-904a-560f380ed872 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:19.994082 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3f9b96e8-5429-4358-904a-560f380ed872 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:19.994522 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3f9b96e8-5429-4358-904a-560f380ed872 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:20.021532 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-3f9b96e8-5429-4358-904a-560f380ed872 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Going to try to terminate instance {{(pid=114105) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 19 08:28:20.037670 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-66b48dac-d4d8-4a5f-aee1-e1df2436cf85 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 28636 microversion: 2.1 time: 0.104955 Oct 19 08:28:20.038302 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 409/808] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:28:19 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 28636 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:28:20.044045 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c7124c9c-5e81-40cf-ba4b-0ac7ffd92c59 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:20.045113 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c7124c9c-5e81-40cf-ba4b-0ac7ffd92c59 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:20.052170 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c7124c9c-5e81-40cf-ba4b-0ac7ffd92c59 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:20.052728 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c7124c9c-5e81-40cf-ba4b-0ac7ffd92c59 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:20.053559 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c7124c9c-5e81-40cf-ba4b-0ac7ffd92c59 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:20.054056 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c7124c9c-5e81-40cf-ba4b-0ac7ffd92c59 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:20.106457 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-3f9b96e8-5429-4358-904a-560f380ed872 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 204 len: 0 microversion: 2.1 time: 0.124868 Oct 19 08:28:20.107035 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 400/809] 10.222.0.26 () {58 vars in 1238 bytes} [Tue Oct 19 08:28:19 2021] DELETE /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 08:28:20.115980 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c5d7e6a8-5222-4755-8ee3-c98618a3fc1b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:20.116743 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-c5d7e6a8-5222-4755-8ee3-c98618a3fc1b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:20.122298 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c5d7e6a8-5222-4755-8ee3-c98618a3fc1b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:20.122800 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c5d7e6a8-5222-4755-8ee3-c98618a3fc1b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:20.123600 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c5d7e6a8-5222-4755-8ee3-c98618a3fc1b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:20.124020 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c5d7e6a8-5222-4755-8ee3-c98618a3fc1b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:20.163372 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c7124c9c-5e81-40cf-ba4b-0ac7ffd92c59 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 33482 microversion: 2.20 time: 0.123368 Oct 19 08:28:20.166583 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 410/810] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:28:20 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 33482 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:28:20.256190 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-c5d7e6a8-5222-4755-8ee3-c98618a3fc1b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:20.263658 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-c5d7e6a8-5222-4755-8ee3-c98618a3fc1b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1514 microversion: 2.1 time: 0.152199 Oct 19 08:28:20.264501 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 401/811] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:20 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:20.448843 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-4a27d9f7-9931-438e-8983-87c4055bbcb7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:20.449527 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-4a27d9f7-9931-438e-8983-87c4055bbcb7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:20.455847 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4a27d9f7-9931-438e-8983-87c4055bbcb7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:20.456338 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4a27d9f7-9931-438e-8983-87c4055bbcb7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:20.458086 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4a27d9f7-9931-438e-8983-87c4055bbcb7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:20.458547 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4a27d9f7-9931-438e-8983-87c4055bbcb7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:20.487234 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-64deb8b7-1d20-4725-a1d1-3b0607fe7614 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:20.487840 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-64deb8b7-1d20-4725-a1d1-3b0607fe7614 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: ee918319-a52e-42ad-be1f-026c3f704860] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:20.494109 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-64deb8b7-1d20-4725-a1d1-3b0607fe7614 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:20.494587 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-64deb8b7-1d20-4725-a1d1-3b0607fe7614 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:20.495352 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-64deb8b7-1d20-4725-a1d1-3b0607fe7614 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:20.495782 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-64deb8b7-1d20-4725-a1d1-3b0607fe7614 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:20.608418 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-4a27d9f7-9931-438e-8983-87c4055bbcb7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:20.616305 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-4a27d9f7-9931-438e-8983-87c4055bbcb7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1561 microversion: 2.1 time: 0.171553 Oct 19 08:28:20.616863 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 411/812] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:20 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:20.657645 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-64deb8b7-1d20-4725-a1d1-3b0607fe7614 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:20.665053 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-64deb8b7-1d20-4725-a1d1-3b0607fe7614 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860" status: 200 len: 1318 microversion: 2.1 time: 0.181402 Oct 19 08:28:20.665602 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 402/813] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:20 2021] GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:28:20.682848 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a16c9271-0810-4757-9120-ca6a646bea7d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:20.683338 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a16c9271-0810-4757-9120-ca6a646bea7d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:20.689018 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a16c9271-0810-4757-9120-ca6a646bea7d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:20.689463 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a16c9271-0810-4757-9120-ca6a646bea7d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:20.690244 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a16c9271-0810-4757-9120-ca6a646bea7d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:20.690715 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a16c9271-0810-4757-9120-ca6a646bea7d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:20.766580 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.objects.instance [None req-a16c9271-0810-4757-9120-ca6a646bea7d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lazy-loading 'services' on Instance uuid a2a856f6-f552-461f-8d9c-4bf017cbbac5 {{(pid=114106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 19 08:28:20.832941 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a16c9271-0810-4757-9120-ca6a646bea7d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5/os-volume_attachments/2bdd5a60-577c-4198-832c-a98b07308b49" status: 202 len: 0 microversion: 2.1 time: 0.153519 Oct 19 08:28:20.833517 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 412/814] 10.222.0.26 () {58 vars in 1415 bytes} [Tue Oct 19 08:28:20 2021] DELETE /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5/os-volume_attachments/2bdd5a60-577c-4198-832c-a98b07308b49 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:28:20.842203 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-ebf9b9e2-9ee7-41ea-b21d-5acf00199e3e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:20.843165 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-ebf9b9e2-9ee7-41ea-b21d-5acf00199e3e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:20.849250 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ebf9b9e2-9ee7-41ea-b21d-5acf00199e3e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:20.849749 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ebf9b9e2-9ee7-41ea-b21d-5acf00199e3e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:20.850594 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ebf9b9e2-9ee7-41ea-b21d-5acf00199e3e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:20.851078 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ebf9b9e2-9ee7-41ea-b21d-5acf00199e3e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:20.882402 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-ebf9b9e2-9ee7-41ea-b21d-5acf00199e3e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043706 Oct 19 08:28:20.882926 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 403/815] 10.222.0.26 () {58 vars in 1301 bytes} [Tue Oct 19 08:28:20 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:28:21.049539 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-81c93603-407f-4adb-833c-315d7010bf62 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:21.051103 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-81c93603-407f-4adb-833c-315d7010bf62 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:21.056986 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-81c93603-407f-4adb-833c-315d7010bf62 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:21.057422 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-81c93603-407f-4adb-833c-315d7010bf62 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:21.058165 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-81c93603-407f-4adb-833c-315d7010bf62 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:21.058613 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-81c93603-407f-4adb-833c-315d7010bf62 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:21.134272 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-81c93603-407f-4adb-833c-315d7010bf62 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 29915 microversion: 2.1 time: 0.088586 Oct 19 08:28:21.134918 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 413/816] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:28:21 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 29915 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:28:21.174411 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-dc1f31ff-dba1-4741-9efc-baf1accc419f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:21.175260 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-dc1f31ff-dba1-4741-9efc-baf1accc419f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:21.181833 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dc1f31ff-dba1-4741-9efc-baf1accc419f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:21.182271 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dc1f31ff-dba1-4741-9efc-baf1accc419f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:21.183042 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dc1f31ff-dba1-4741-9efc-baf1accc419f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:21.183464 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dc1f31ff-dba1-4741-9efc-baf1accc419f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:21.281435 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-39933013-73f5-4e99-87f8-a4d47718712b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:21.282123 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-39933013-73f5-4e99-87f8-a4d47718712b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:21.289683 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-39933013-73f5-4e99-87f8-a4d47718712b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:21.290017 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-39933013-73f5-4e99-87f8-a4d47718712b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:21.290682 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-39933013-73f5-4e99-87f8-a4d47718712b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:21.291116 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-39933013-73f5-4e99-87f8-a4d47718712b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:21.302806 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-dc1f31ff-dba1-4741-9efc-baf1accc419f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 34088 microversion: 2.20 time: 0.131569 Oct 19 08:28:21.304513 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 404/817] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:28:21 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 34088 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:28:21.431478 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-39933013-73f5-4e99-87f8-a4d47718712b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:21.439258 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-39933013-73f5-4e99-87f8-a4d47718712b tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1514 microversion: 2.1 time: 0.161807 Oct 19 08:28:21.439823 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 414/818] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:21 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:28:21.681610 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-dd5e2707-c58b-44b1-ae27-4a295dba772a tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:21.682221 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-dd5e2707-c58b-44b1-ae27-4a295dba772a tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: ee918319-a52e-42ad-be1f-026c3f704860] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:21.688507 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dd5e2707-c58b-44b1-ae27-4a295dba772a tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:21.688954 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dd5e2707-c58b-44b1-ae27-4a295dba772a tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:21.689707 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dd5e2707-c58b-44b1-ae27-4a295dba772a tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:21.690134 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dd5e2707-c58b-44b1-ae27-4a295dba772a tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:21.851859 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-dd5e2707-c58b-44b1-ae27-4a295dba772a tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:21.859465 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-dd5e2707-c58b-44b1-ae27-4a295dba772a tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860" status: 200 len: 1318 microversion: 2.1 time: 0.181854 Oct 19 08:28:21.860049 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 405/819] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:21 2021] GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:21.893198 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-9db8b7e9-4252-457d-90f7-604988f039bd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:21.894472 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-9db8b7e9-4252-457d-90f7-604988f039bd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:21.900921 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9db8b7e9-4252-457d-90f7-604988f039bd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:21.901449 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9db8b7e9-4252-457d-90f7-604988f039bd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:21.902269 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9db8b7e9-4252-457d-90f7-604988f039bd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:21.902937 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9db8b7e9-4252-457d-90f7-604988f039bd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:21.933531 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-9db8b7e9-4252-457d-90f7-604988f039bd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044117 Oct 19 08:28:21.937410 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 415/820] 10.222.0.26 () {58 vars in 1301 bytes} [Tue Oct 19 08:28:21 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:28:22.146857 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-523bf461-3ef9-4426-9c7c-b533b1ec6f36 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:22.147757 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-523bf461-3ef9-4426-9c7c-b533b1ec6f36 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:22.153523 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-523bf461-3ef9-4426-9c7c-b533b1ec6f36 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:22.153964 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-523bf461-3ef9-4426-9c7c-b533b1ec6f36 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:22.154747 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-523bf461-3ef9-4426-9c7c-b533b1ec6f36 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:22.155174 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-523bf461-3ef9-4426-9c7c-b533b1ec6f36 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:22.315028 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3d7dd072-cc0d-4fc1-8856-0c046cd8ccda tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:22.315931 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3d7dd072-cc0d-4fc1-8856-0c046cd8ccda tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:22.322710 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3d7dd072-cc0d-4fc1-8856-0c046cd8ccda tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:22.323159 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3d7dd072-cc0d-4fc1-8856-0c046cd8ccda tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:22.323924 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3d7dd072-cc0d-4fc1-8856-0c046cd8ccda tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:22.324352 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3d7dd072-cc0d-4fc1-8856-0c046cd8ccda tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:27.190861 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-523bf461-3ef9-4426-9c7c-b533b1ec6f36 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 36810 microversion: 2.1 time: 5.048233 Oct 19 08:28:27.191409 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 406/821] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:28:22 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 36810 bytes in 5050 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:28:27.196126 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-59ac1188-12f8-4e5b-8a78-8d3b2d13b341 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:27.196804 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-59ac1188-12f8-4e5b-8a78-8d3b2d13b341 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:27.203108 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-59ac1188-12f8-4e5b-8a78-8d3b2d13b341 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:27.203551 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-59ac1188-12f8-4e5b-8a78-8d3b2d13b341 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:27.204304 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-59ac1188-12f8-4e5b-8a78-8d3b2d13b341 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:27.204732 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-59ac1188-12f8-4e5b-8a78-8d3b2d13b341 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:27.324578 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-59ac1188-12f8-4e5b-8a78-8d3b2d13b341 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:27.331655 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-59ac1188-12f8-4e5b-8a78-8d3b2d13b341 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1514 microversion: 2.1 time: 0.139201 Oct 19 08:28:27.332453 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 407/822] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:27 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1514 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:27.336614 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-00e2eb85-f138-491f-a146-99da1a059e17 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:27.337201 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-00e2eb85-f138-491f-a146-99da1a059e17 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: ee918319-a52e-42ad-be1f-026c3f704860] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:27.342590 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-00e2eb85-f138-491f-a146-99da1a059e17 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:27.343033 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-00e2eb85-f138-491f-a146-99da1a059e17 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:27.343801 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-00e2eb85-f138-491f-a146-99da1a059e17 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:27.344203 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-00e2eb85-f138-491f-a146-99da1a059e17 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:27.346051 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3d7dd072-cc0d-4fc1-8856-0c046cd8ccda tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 38221 microversion: 2.20 time: 5.034521 Oct 19 08:28:27.346728 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 416/823] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:28:22 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 38221 bytes in 5036 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:28:27.352197 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-6cffaab7-0802-494e-ac6c-0826000e0ce9 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:27.353176 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-6cffaab7-0802-494e-ac6c-0826000e0ce9 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:27.359195 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6cffaab7-0802-494e-ac6c-0826000e0ce9 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:27.359664 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6cffaab7-0802-494e-ac6c-0826000e0ce9 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:27.360417 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6cffaab7-0802-494e-ac6c-0826000e0ce9 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:27.360838 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6cffaab7-0802-494e-ac6c-0826000e0ce9 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:27.395089 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-6cffaab7-0802-494e-ac6c-0826000e0ce9 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046615 Oct 19 08:28:27.395846 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 417/824] 10.222.0.26 () {58 vars in 1301 bytes} [Tue Oct 19 08:28:27 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 08:28:27.466559 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-00e2eb85-f138-491f-a146-99da1a059e17 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:27.474685 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-00e2eb85-f138-491f-a146-99da1a059e17 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860" status: 200 len: 1318 microversion: 2.1 time: 0.141258 Oct 19 08:28:27.475241 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 408/825] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:27 2021] GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860 => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:28.202689 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3b9c7882-53e5-4fcb-b8de-3e926309412d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:28.203529 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3b9c7882-53e5-4fcb-b8de-3e926309412d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:28.209791 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3b9c7882-53e5-4fcb-b8de-3e926309412d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:28.210224 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3b9c7882-53e5-4fcb-b8de-3e926309412d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:28.210992 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3b9c7882-53e5-4fcb-b8de-3e926309412d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:28.211414 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3b9c7882-53e5-4fcb-b8de-3e926309412d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:28.302976 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3b9c7882-53e5-4fcb-b8de-3e926309412d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 38022 microversion: 2.1 time: 0.103771 Oct 19 08:28:28.303625 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 418/826] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:28:28 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 38022 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:28:28.348754 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-58ade1f8-a41e-4655-8ef9-01db75907759 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:28.349364 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-58ade1f8-a41e-4655-8ef9-01db75907759 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:28.355646 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-58ade1f8-a41e-4655-8ef9-01db75907759 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:28.356094 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-58ade1f8-a41e-4655-8ef9-01db75907759 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:28.356863 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-58ade1f8-a41e-4655-8ef9-01db75907759 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:28.357296 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-58ade1f8-a41e-4655-8ef9-01db75907759 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:28.358928 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-10063131-2dbd-44bc-9546-9ad36790deb3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:28.360089 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-10063131-2dbd-44bc-9546-9ad36790deb3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:28.368149 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-10063131-2dbd-44bc-9546-9ad36790deb3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:28.368985 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-10063131-2dbd-44bc-9546-9ad36790deb3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:28.369976 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-10063131-2dbd-44bc-9546-9ad36790deb3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:28.370633 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-10063131-2dbd-44bc-9546-9ad36790deb3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:28.460076 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-10063131-2dbd-44bc-9546-9ad36790deb3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 38221 microversion: 2.20 time: 0.104970 Oct 19 08:28:28.464743 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 419/827] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:28:28 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 38221 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:28:28.491672 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-6f2c3299-a548-491f-81d2-8a9d59d9df3b tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:28.492344 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-6f2c3299-a548-491f-81d2-8a9d59d9df3b tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: ee918319-a52e-42ad-be1f-026c3f704860] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:28.498775 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6f2c3299-a548-491f-81d2-8a9d59d9df3b tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:28.499207 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6f2c3299-a548-491f-81d2-8a9d59d9df3b tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:28.499952 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6f2c3299-a548-491f-81d2-8a9d59d9df3b tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:28.500368 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6f2c3299-a548-491f-81d2-8a9d59d9df3b tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:28.600280 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-58ade1f8-a41e-4655-8ef9-01db75907759 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3db95dc956487ead5e579b58451580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e6b0972cf140649ed2cad14f2db0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:28.608048 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-58ade1f8-a41e-4655-8ef9-01db75907759 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 200 len: 1514 microversion: 2.1 time: 0.263207 Oct 19 08:28:28.608648 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 409/828] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:28 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 1514 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:28.707648 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-6f2c3299-a548-491f-81d2-8a9d59d9df3b tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:28.714906 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-6f2c3299-a548-491f-81d2-8a9d59d9df3b tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860" status: 200 len: 1318 microversion: 2.1 time: 0.227321 Oct 19 08:28:28.715378 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 420/829] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:28 2021] GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:28:28.855493 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-a2079c4b-4513-44cd-b796-00c03571805e req-15df0170-bd73-400d-9092-7fc7d89b0378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b75e6c63-1b3e-4a9c-adbc-9db31920288f", "name": "network-vif-deleted", "tag": "a1452749-7697-4896-9845-e408f2432615"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:28.857269 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:28:28.857269 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:28:28.865074 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-a2079c4b-4513-44cd-b796-00c03571805e req-15df0170-bd73-400d-9092-7fc7d89b0378 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:28.865517 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-a2079c4b-4513-44cd-b796-00c03571805e req-15df0170-bd73-400d-9092-7fc7d89b0378 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:28.878153 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-a2079c4b-4513-44cd-b796-00c03571805e req-15df0170-bd73-400d-9092-7fc7d89b0378 service nova] Creating event network-vif-deleted:a1452749-7697-4896-9845-e408f2432615 for instance b75e6c63-1b3e-4a9c-adbc-9db31920288f on hv-cinder-81398 Oct 19 08:28:28.884911 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-a2079c4b-4513-44cd-b796-00c03571805e req-15df0170-bd73-400d-9092-7fc7d89b0378 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032773 Oct 19 08:28:28.885593 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 410/830] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:28:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:28:29.314991 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-1e56c692-cbe8-40c5-9f21-f51df07cd6cb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:29.315939 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-1e56c692-cbe8-40c5-9f21-f51df07cd6cb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:29.321714 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1e56c692-cbe8-40c5-9f21-f51df07cd6cb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:29.322152 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1e56c692-cbe8-40c5-9f21-f51df07cd6cb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:29.322943 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1e56c692-cbe8-40c5-9f21-f51df07cd6cb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:29.323375 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1e56c692-cbe8-40c5-9f21-f51df07cd6cb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:29.400050 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-1e56c692-cbe8-40c5-9f21-f51df07cd6cb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 38145 microversion: 2.1 time: 0.088582 Oct 19 08:28:29.401076 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 421/831] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:28:29 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 38145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:28:29.472877 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-5a590ad0-cdac-45f0-a93e-bfd2c3659e60 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:29.473904 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-5a590ad0-cdac-45f0-a93e-bfd2c3659e60 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:29.479879 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5a590ad0-cdac-45f0-a93e-bfd2c3659e60 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:29.480321 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5a590ad0-cdac-45f0-a93e-bfd2c3659e60 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:29.481067 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5a590ad0-cdac-45f0-a93e-bfd2c3659e60 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:29.481493 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5a590ad0-cdac-45f0-a93e-bfd2c3659e60 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:29.540811 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-5a590ad0-cdac-45f0-a93e-bfd2c3659e60 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 38221 microversion: 2.20 time: 0.071877 Oct 19 08:28:29.541334 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 411/832] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:28:29 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 38221 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:28:29.625383 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ec67c974-5e7c-4a3f-b509-ee8e33dcb4b7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:29.626630 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ec67c974-5e7c-4a3f-b509-ee8e33dcb4b7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] [instance: b75e6c63-1b3e-4a9c-adbc-9db31920288f] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:29.633601 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ec67c974-5e7c-4a3f-b509-ee8e33dcb4b7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:29.634043 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ec67c974-5e7c-4a3f-b509-ee8e33dcb4b7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:29.634847 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ec67c974-5e7c-4a3f-b509-ee8e33dcb4b7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:29.635278 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ec67c974-5e7c-4a3f-b509-ee8e33dcb4b7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:29.649531 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.wsgi [None req-ec67c974-5e7c-4a3f-b509-ee8e33dcb4b7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] HTTP exception thrown: Instance b75e6c63-1b3e-4a9c-adbc-9db31920288f could not be found. Oct 19 08:28:29.650120 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ec67c974-5e7c-4a3f-b509-ee8e33dcb4b7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] Returning 404 to user: Instance b75e6c63-1b3e-4a9c-adbc-9db31920288f could not be found. {{(pid=114106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:28:29.650960 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ec67c974-5e7c-4a3f-b509-ee8e33dcb4b7 tempest-AttachVolumeNegativeTest-1913401580 tempest-AttachVolumeNegativeTest-1913401580-project] 10.222.0.26 "GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f" status: 404 len: 111 microversion: 2.1 time: 0.029668 Oct 19 08:28:29.651489 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 422/833] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:29 2021] GET /compute/v2.1/servers/b75e6c63-1b3e-4a9c-adbc-9db31920288f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:28:29.732231 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2d512de5-d06a-4879-a5b9-ff68fed82ce2 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:29.733105 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2d512de5-d06a-4879-a5b9-ff68fed82ce2 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: ee918319-a52e-42ad-be1f-026c3f704860] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:29.740439 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2d512de5-d06a-4879-a5b9-ff68fed82ce2 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:29.740603 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2d512de5-d06a-4879-a5b9-ff68fed82ce2 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:29.741552 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2d512de5-d06a-4879-a5b9-ff68fed82ce2 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:29.742306 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2d512de5-d06a-4879-a5b9-ff68fed82ce2 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:29.877188 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-785c2d37-fe36-4a6c-ab95-912227d36a79 req-e8ffdef9-0041-43e8-961a-c48dd4f1586a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee918319-a52e-42ad-be1f-026c3f704860", "name": "network-vif-plugged", "status": "completed", "tag": "f15e40d0-7913-4978-b0ff-8bd4d2ded1ec"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:29.880649 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:28:29.880649 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:28:29.890594 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-785c2d37-fe36-4a6c-ab95-912227d36a79 req-e8ffdef9-0041-43e8-961a-c48dd4f1586a service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:29.891205 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-785c2d37-fe36-4a6c-ab95-912227d36a79 req-e8ffdef9-0041-43e8-961a-c48dd4f1586a service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:29.903354 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-785c2d37-fe36-4a6c-ab95-912227d36a79 req-e8ffdef9-0041-43e8-961a-c48dd4f1586a service nova] Creating event network-vif-plugged:f15e40d0-7913-4978-b0ff-8bd4d2ded1ec for instance ee918319-a52e-42ad-be1f-026c3f704860 on hv-cinder-81398 Oct 19 08:28:29.908278 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-785c2d37-fe36-4a6c-ab95-912227d36a79 req-e8ffdef9-0041-43e8-961a-c48dd4f1586a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036202 Oct 19 08:28:29.909183 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 423/834] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:28:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:28:29.921213 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-2d512de5-d06a-4879-a5b9-ff68fed82ce2 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:29.929648 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2d512de5-d06a-4879-a5b9-ff68fed82ce2 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860" status: 200 len: 1318 microversion: 2.1 time: 0.201588 Oct 19 08:28:29.930872 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 412/835] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:29 2021] GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:30.412789 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-239fac2c-6e61-46c8-8727-61a9b4138ec2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:30.414190 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-239fac2c-6e61-46c8-8727-61a9b4138ec2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:30.422517 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-239fac2c-6e61-46c8-8727-61a9b4138ec2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:30.423289 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-239fac2c-6e61-46c8-8727-61a9b4138ec2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:30.424486 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-239fac2c-6e61-46c8-8727-61a9b4138ec2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:30.425211 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-239fac2c-6e61-46c8-8727-61a9b4138ec2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:30.552387 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-1bdcba48-d6a6-402e-9e62-f9ca4336ced9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:30.553322 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-1bdcba48-d6a6-402e-9e62-f9ca4336ced9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:30.559069 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1bdcba48-d6a6-402e-9e62-f9ca4336ced9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:30.559512 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1bdcba48-d6a6-402e-9e62-f9ca4336ced9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:30.560273 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1bdcba48-d6a6-402e-9e62-f9ca4336ced9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:30.560698 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1bdcba48-d6a6-402e-9e62-f9ca4336ced9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:30.643575 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-1bdcba48-d6a6-402e-9e62-f9ca4336ced9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 200 len: 38364 microversion: 2.20 time: 0.094689 Oct 19 08:28:30.645874 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 413/836] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:28:30 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 38364 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:28:30.652516 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-239fac2c-6e61-46c8-8727-61a9b4138ec2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 38145 microversion: 2.1 time: 0.243918 Oct 19 08:28:30.653647 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 424/837] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:28:30 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 38145 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:28:30.662594 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-39a0baba-7def-4e4f-92bb-478b7f61acc0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:30.663174 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-39a0baba-7def-4e4f-92bb-478b7f61acc0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:30.669736 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-39a0baba-7def-4e4f-92bb-478b7f61acc0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:30.670397 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-39a0baba-7def-4e4f-92bb-478b7f61acc0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:30.671200 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-39a0baba-7def-4e4f-92bb-478b7f61acc0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:30.671628 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-39a0baba-7def-4e4f-92bb-478b7f61acc0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:30.695983 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-39a0baba-7def-4e4f-92bb-478b7f61acc0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/ips" status: 200 len: 153 microversion: 2.20 time: 0.037918 Oct 19 08:28:30.696551 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 414/838] 10.222.0.26 () {60 vars in 1288 bytes} [Tue Oct 19 08:28:30 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/ips => generated 153 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:28:30.750654 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b4b0d7a2-6a67-428f-9228-a57b39d0823e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:30.751303 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b4b0d7a2-6a67-428f-9228-a57b39d0823e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:30.758385 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b4b0d7a2-6a67-428f-9228-a57b39d0823e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:30.758863 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b4b0d7a2-6a67-428f-9228-a57b39d0823e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:30.760268 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b4b0d7a2-6a67-428f-9228-a57b39d0823e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:30.760836 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b4b0d7a2-6a67-428f-9228-a57b39d0823e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:30.787618 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b4b0d7a2-6a67-428f-9228-a57b39d0823e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Going to try to terminate instance {{(pid=114106) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 19 08:28:30.872677 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b4b0d7a2-6a67-428f-9228-a57b39d0823e tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "DELETE /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 204 len: 0 microversion: 2.1 time: 0.125868 Oct 19 08:28:30.873420 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 425/839] 10.222.0.26 () {58 vars in 1238 bytes} [Tue Oct 19 08:28:30 2021] DELETE /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 08:28:30.885485 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-e8a53ff5-30a9-4cb8-afb2-565f37780a1a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:30.886075 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-e8a53ff5-30a9-4cb8-afb2-565f37780a1a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:30.893996 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e8a53ff5-30a9-4cb8-afb2-565f37780a1a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:30.894958 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e8a53ff5-30a9-4cb8-afb2-565f37780a1a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:30.896270 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e8a53ff5-30a9-4cb8-afb2-565f37780a1a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:30.896929 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e8a53ff5-30a9-4cb8-afb2-565f37780a1a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:30.947637 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-52ee67e4-56ff-4db7-befe-cc87a6064e59 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:30.948734 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-52ee67e4-56ff-4db7-befe-cc87a6064e59 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: ee918319-a52e-42ad-be1f-026c3f704860] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:30.958941 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-52ee67e4-56ff-4db7-befe-cc87a6064e59 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:30.959687 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-52ee67e4-56ff-4db7-befe-cc87a6064e59 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:30.960617 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-52ee67e4-56ff-4db7-befe-cc87a6064e59 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:30.961198 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-52ee67e4-56ff-4db7-befe-cc87a6064e59 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:31.094424 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-e8a53ff5-30a9-4cb8-afb2-565f37780a1a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:31.102995 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-e8a53ff5-30a9-4cb8-afb2-565f37780a1a tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1508 microversion: 2.1 time: 0.224866 Oct 19 08:28:31.103816 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 415/840] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:30 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1508 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:31.132646 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-52ee67e4-56ff-4db7-befe-cc87a6064e59 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:31.140469 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-52ee67e4-56ff-4db7-befe-cc87a6064e59 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860" status: 200 len: 1318 microversion: 2.1 time: 0.196877 Oct 19 08:28:31.141111 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 426/841] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:30 2021] GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:31.666239 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8fbc37e1-cbab-4f03-b3df-cf3979f5d914 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:31.667311 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-8fbc37e1-cbab-4f03-b3df-cf3979f5d914 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:31.678131 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8fbc37e1-cbab-4f03-b3df-cf3979f5d914 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:31.678431 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8fbc37e1-cbab-4f03-b3df-cf3979f5d914 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:31.679381 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8fbc37e1-cbab-4f03-b3df-cf3979f5d914 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:31.679966 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8fbc37e1-cbab-4f03-b3df-cf3979f5d914 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:31.772327 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-8fbc37e1-cbab-4f03-b3df-cf3979f5d914 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 38145 microversion: 2.1 time: 0.109809 Oct 19 08:28:31.773712 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 416/842] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:28:31 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 38145 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:28:32.120668 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a27781b9-3eaa-45ff-9a1e-00238eb11e60 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:32.121229 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a27781b9-3eaa-45ff-9a1e-00238eb11e60 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:32.128993 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a27781b9-3eaa-45ff-9a1e-00238eb11e60 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:32.129451 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a27781b9-3eaa-45ff-9a1e-00238eb11e60 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:32.130223 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a27781b9-3eaa-45ff-9a1e-00238eb11e60 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:32.130723 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a27781b9-3eaa-45ff-9a1e-00238eb11e60 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:32.157960 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-80cadf4c-1070-4b31-af30-6a9d4d7a40dd tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:32.158904 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-80cadf4c-1070-4b31-af30-6a9d4d7a40dd tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: ee918319-a52e-42ad-be1f-026c3f704860] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:32.166909 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-80cadf4c-1070-4b31-af30-6a9d4d7a40dd tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:32.167358 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-80cadf4c-1070-4b31-af30-6a9d4d7a40dd tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:32.168360 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-80cadf4c-1070-4b31-af30-6a9d4d7a40dd tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:32.168962 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-80cadf4c-1070-4b31-af30-6a9d4d7a40dd tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:32.321299 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a27781b9-3eaa-45ff-9a1e-00238eb11e60 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:32.332970 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a27781b9-3eaa-45ff-9a1e-00238eb11e60 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1508 microversion: 2.1 time: 0.215436 Oct 19 08:28:32.333663 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 427/843] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:32 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1508 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:32.344565 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-80cadf4c-1070-4b31-af30-6a9d4d7a40dd tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:32.353245 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-80cadf4c-1070-4b31-af30-6a9d4d7a40dd tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860" status: 200 len: 1506 microversion: 2.1 time: 0.199276 Oct 19 08:28:32.354335 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 417/844] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:32 2021] GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860 => generated 1506 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:32.372093 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e80c7387-7929-4fc9-b3fd-15ee62e80afd tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74db349b-79ab-4de2-b217-6d5148fd71be", "device": "/dev/sdb"}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:32.373422 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e80c7387-7929-4fc9-b3fd-15ee62e80afd tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: ee918319-a52e-42ad-be1f-026c3f704860] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:32.382257 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e80c7387-7929-4fc9-b3fd-15ee62e80afd tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:32.382739 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e80c7387-7929-4fc9-b3fd-15ee62e80afd tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:32.383499 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e80c7387-7929-4fc9-b3fd-15ee62e80afd tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:32.383921 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e80c7387-7929-4fc9-b3fd-15ee62e80afd tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:32.633810 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e80c7387-7929-4fc9-b3fd-15ee62e80afd tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "POST /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266075 Oct 19 08:28:32.634431 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 428/845] 10.222.0.26 () {60 vars in 1322 bytes} [Tue Oct 19 08:28:32 2021] POST /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 08:28:32.784387 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-3513fdc1-4132-4be1-bc44-f5a4be0f1ff3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:32.785878 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-3513fdc1-4132-4be1-bc44-f5a4be0f1ff3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:32.792437 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3513fdc1-4132-4be1-bc44-f5a4be0f1ff3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:32.792906 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3513fdc1-4132-4be1-bc44-f5a4be0f1ff3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:32.793675 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3513fdc1-4132-4be1-bc44-f5a4be0f1ff3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:32.794102 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3513fdc1-4132-4be1-bc44-f5a4be0f1ff3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:32.861197 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-3513fdc1-4132-4be1-bc44-f5a4be0f1ff3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 38145 microversion: 2.1 time: 0.080203 Oct 19 08:28:32.862118 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 418/846] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:28:32 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 38145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:28:33.283540 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-378e356a-cedd-4a0c-982f-f7df302d4c80 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:33.284150 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-378e356a-cedd-4a0c-982f-f7df302d4c80 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:33.290849 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-378e356a-cedd-4a0c-982f-f7df302d4c80 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:33.291289 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-378e356a-cedd-4a0c-982f-f7df302d4c80 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:33.292040 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-378e356a-cedd-4a0c-982f-f7df302d4c80 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:33.292465 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-378e356a-cedd-4a0c-982f-f7df302d4c80 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:33.315635 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.objects.instance [None req-378e356a-cedd-4a0c-982f-f7df302d4c80 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lazy-loading 'flavor' on Instance uuid fe7dae80-4592-45ea-a52d-05aa559c102a {{(pid=114106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 19 08:28:33.350833 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-29a4ef32-e1f9-4eb8-959e-7bf14e751b0d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:33.351528 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-29a4ef32-e1f9-4eb8-959e-7bf14e751b0d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:33.357990 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-29a4ef32-e1f9-4eb8-959e-7bf14e751b0d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:33.358535 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-29a4ef32-e1f9-4eb8-959e-7bf14e751b0d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:33.359296 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-29a4ef32-e1f9-4eb8-959e-7bf14e751b0d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:33.359725 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-29a4ef32-e1f9-4eb8-959e-7bf14e751b0d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:33.498644 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-29a4ef32-e1f9-4eb8-959e-7bf14e751b0d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:33.511189 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-29a4ef32-e1f9-4eb8-959e-7bf14e751b0d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1508 microversion: 2.1 time: 0.164423 Oct 19 08:28:33.520766 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 419/847] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:33 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:28:33.588582 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-378e356a-cedd-4a0c-982f-f7df302d4c80 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 202 len: 0 microversion: 2.20 time: 0.308601 Oct 19 08:28:33.592308 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 429/848] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:28:33 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 08:28:33.597476 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-77bcb265-0753-4e6a-979d-6713b98ac995 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:33.598733 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-77bcb265-0753-4e6a-979d-6713b98ac995 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:33.604810 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-77bcb265-0753-4e6a-979d-6713b98ac995 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:33.605444 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-77bcb265-0753-4e6a-979d-6713b98ac995 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:33.606205 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-77bcb265-0753-4e6a-979d-6713b98ac995 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:33.606806 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-77bcb265-0753-4e6a-979d-6713b98ac995 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:33.733504 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-77bcb265-0753-4e6a-979d-6713b98ac995 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:33.741321 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-77bcb265-0753-4e6a-979d-6713b98ac995 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:33.742818 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-77bcb265-0753-4e6a-979d-6713b98ac995 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:33.743959 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-77bcb265-0753-4e6a-979d-6713b98ac995 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1725 microversion: 2.20 time: 0.150209 Oct 19 08:28:33.744504 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 420/849] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:28:33 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:28:33.907629 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-26ae4724-8e18-4c0c-90ed-08bfc7832db1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:33.908625 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-26ae4724-8e18-4c0c-90ed-08bfc7832db1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:33.914719 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-26ae4724-8e18-4c0c-90ed-08bfc7832db1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:33.915156 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-26ae4724-8e18-4c0c-90ed-08bfc7832db1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:33.915905 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-26ae4724-8e18-4c0c-90ed-08bfc7832db1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:33.916320 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-26ae4724-8e18-4c0c-90ed-08bfc7832db1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:34.054655 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-26ae4724-8e18-4c0c-90ed-08bfc7832db1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 200 len: 38276 microversion: 2.1 time: 0.150713 Oct 19 08:28:34.055408 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 430/850] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:28:33 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 38276 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:28:34.065250 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-f198b80a-b6da-4918-82e5-95937f13c2e5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:34.065789 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-f198b80a-b6da-4918-82e5-95937f13c2e5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:34.072167 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f198b80a-b6da-4918-82e5-95937f13c2e5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:34.072970 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f198b80a-b6da-4918-82e5-95937f13c2e5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:34.073522 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f198b80a-b6da-4918-82e5-95937f13c2e5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:34.073960 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f198b80a-b6da-4918-82e5-95937f13c2e5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:34.097477 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-f198b80a-b6da-4918-82e5-95937f13c2e5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/ips" status: 200 len: 145 microversion: 2.1 time: 0.035915 Oct 19 08:28:34.098038 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 421/851] 10.222.0.26 () {58 vars in 1247 bytes} [Tue Oct 19 08:28:34 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:28:34.528948 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-d9dcf152-f486-4a14-96f7-95b9c299a907 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:34.530367 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-d9dcf152-f486-4a14-96f7-95b9c299a907 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:34.541434 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d9dcf152-f486-4a14-96f7-95b9c299a907 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:34.542134 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d9dcf152-f486-4a14-96f7-95b9c299a907 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:34.543158 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d9dcf152-f486-4a14-96f7-95b9c299a907 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:34.543808 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d9dcf152-f486-4a14-96f7-95b9c299a907 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:34.763279 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-82cc6fdf-ff94-4e01-88ec-3014c7938459 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:34.764357 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-82cc6fdf-ff94-4e01-88ec-3014c7938459 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:34.772731 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-82cc6fdf-ff94-4e01-88ec-3014c7938459 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:34.773179 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-82cc6fdf-ff94-4e01-88ec-3014c7938459 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:34.773960 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-82cc6fdf-ff94-4e01-88ec-3014c7938459 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:34.774390 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-82cc6fdf-ff94-4e01-88ec-3014c7938459 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:34.786110 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-d9dcf152-f486-4a14-96f7-95b9c299a907 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:34.794998 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-d9dcf152-f486-4a14-96f7-95b9c299a907 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 200 len: 1508 microversion: 2.1 time: 0.270696 Oct 19 08:28:34.795835 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 431/852] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:34 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 1508 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:35.007798 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-82cc6fdf-ff94-4e01-88ec-3014c7938459 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:35.021197 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-82cc6fdf-ff94-4e01-88ec-3014c7938459 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:35.025443 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-82cc6fdf-ff94-4e01-88ec-3014c7938459 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:35.030903 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-82cc6fdf-ff94-4e01-88ec-3014c7938459 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1725 microversion: 2.20 time: 0.269314 Oct 19 08:28:35.032186 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 422/853] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:28:34 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1725 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:28:35.113368 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-57a32e00-533b-4439-b1b6-46ede6c7d867 req-602df1f5-00f3-4d24-970a-b7b46b985c29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feb56f1c-831c-4725-b502-fbf7f6b9fe5b", "name": "network-vif-deleted", "tag": "af354896-e292-4dc8-8c66-71861bbc0358"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:35.115107 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:28:35.115107 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:28:35.123081 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-57a32e00-533b-4439-b1b6-46ede6c7d867 req-602df1f5-00f3-4d24-970a-b7b46b985c29 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:35.123889 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-57a32e00-533b-4439-b1b6-46ede6c7d867 req-602df1f5-00f3-4d24-970a-b7b46b985c29 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:35.136482 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-57a32e00-533b-4439-b1b6-46ede6c7d867 req-602df1f5-00f3-4d24-970a-b7b46b985c29 service nova] Creating event network-vif-deleted:af354896-e292-4dc8-8c66-71861bbc0358 for instance feb56f1c-831c-4725-b502-fbf7f6b9fe5b on hv-cinder-81398 Oct 19 08:28:35.141936 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-57a32e00-533b-4439-b1b6-46ede6c7d867 req-602df1f5-00f3-4d24-970a-b7b46b985c29 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032930 Oct 19 08:28:35.143191 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 432/854] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:28:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:28:35.813410 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-e3573e63-0cc3-4168-a239-4674d5b18457 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:35.814310 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-e3573e63-0cc3-4168-a239-4674d5b18457 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: feb56f1c-831c-4725-b502-fbf7f6b9fe5b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:35.823648 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e3573e63-0cc3-4168-a239-4674d5b18457 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:35.824509 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e3573e63-0cc3-4168-a239-4674d5b18457 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:35.825576 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e3573e63-0cc3-4168-a239-4674d5b18457 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:35.826013 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e3573e63-0cc3-4168-a239-4674d5b18457 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:35.839987 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.wsgi [None req-e3573e63-0cc3-4168-a239-4674d5b18457 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] HTTP exception thrown: Instance feb56f1c-831c-4725-b502-fbf7f6b9fe5b could not be found. Oct 19 08:28:35.840577 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-e3573e63-0cc3-4168-a239-4674d5b18457 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Returning 404 to user: Instance feb56f1c-831c-4725-b502-fbf7f6b9fe5b could not be found. {{(pid=114105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:28:35.841387 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-e3573e63-0cc3-4168-a239-4674d5b18457 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b" status: 404 len: 111 microversion: 2.1 time: 0.032302 Oct 19 08:28:35.842237 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 423/855] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:35 2021] GET /compute/v2.1/servers/feb56f1c-831c-4725-b502-fbf7f6b9fe5b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:28:35.851381 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-9ee341f2-0766-4d2b-b297-bbe62ff66dfd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:35.852079 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-9ee341f2-0766-4d2b-b297-bbe62ff66dfd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:35.857882 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9ee341f2-0766-4d2b-b297-bbe62ff66dfd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:35.858598 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9ee341f2-0766-4d2b-b297-bbe62ff66dfd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:35.859112 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9ee341f2-0766-4d2b-b297-bbe62ff66dfd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:35.859540 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9ee341f2-0766-4d2b-b297-bbe62ff66dfd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:35.886944 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-9ee341f2-0766-4d2b-b297-bbe62ff66dfd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Going to try to terminate instance {{(pid=114106) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 19 08:28:35.957685 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-9ee341f2-0766-4d2b-b297-bbe62ff66dfd tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 204 len: 0 microversion: 2.1 time: 0.110419 Oct 19 08:28:35.958253 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 433/856] 10.222.0.26 () {58 vars in 1238 bytes} [Tue Oct 19 08:28:35 2021] DELETE /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 08:28:35.966474 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-726df1a2-e713-4c80-9136-55ab0a650fed tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:35.967100 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-726df1a2-e713-4c80-9136-55ab0a650fed tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:35.973493 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-726df1a2-e713-4c80-9136-55ab0a650fed tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:35.974033 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-726df1a2-e713-4c80-9136-55ab0a650fed tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:35.974833 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-726df1a2-e713-4c80-9136-55ab0a650fed tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:35.975267 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-726df1a2-e713-4c80-9136-55ab0a650fed tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:36.050716 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-67f27d16-810e-4860-8c7a-32015fdca4a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:36.051420 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-67f27d16-810e-4860-8c7a-32015fdca4a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:36.057172 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-67f27d16-810e-4860-8c7a-32015fdca4a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:36.057531 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-67f27d16-810e-4860-8c7a-32015fdca4a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:36.058286 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-67f27d16-810e-4860-8c7a-32015fdca4a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:36.058804 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-67f27d16-810e-4860-8c7a-32015fdca4a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:36.099630 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-726df1a2-e713-4c80-9136-55ab0a650fed tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:36.107117 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-726df1a2-e713-4c80-9136-55ab0a650fed tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1521 microversion: 2.1 time: 0.144252 Oct 19 08:28:36.107781 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 424/857] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:35 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:36.182903 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-67f27d16-810e-4860-8c7a-32015fdca4a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:36.190405 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-67f27d16-810e-4860-8c7a-32015fdca4a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:36.196486 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-67f27d16-810e-4860-8c7a-32015fdca4a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:36.197720 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-67f27d16-810e-4860-8c7a-32015fdca4a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1725 microversion: 2.20 time: 0.151154 Oct 19 08:28:36.198265 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 434/858] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:28:36 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:28:36.409125 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8995c769-f0d9-4fa1-861b-ff3095e5ff3d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a877fbe9-49f9-44a7-8a11-8235a045a2f6"}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:36.410632 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-8995c769-f0d9-4fa1-861b-ff3095e5ff3d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:36.417204 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8995c769-f0d9-4fa1-861b-ff3095e5ff3d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:36.417721 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8995c769-f0d9-4fa1-861b-ff3095e5ff3d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:36.418620 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8995c769-f0d9-4fa1-861b-ff3095e5ff3d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:36.419135 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8995c769-f0d9-4fa1-861b-ff3095e5ff3d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:36.664385 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-8995c769-f0d9-4fa1-861b-ff3095e5ff3d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258974 Oct 19 08:28:36.664989 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 425/859] 10.222.0.26 () {60 vars in 1322 bytes} [Tue Oct 19 08:28:36 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:28:37.124469 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-88fecd88-4d3a-4e57-9816-cad283d2fe7b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:37.125077 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-88fecd88-4d3a-4e57-9816-cad283d2fe7b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:37.134726 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-88fecd88-4d3a-4e57-9816-cad283d2fe7b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:37.135297 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-88fecd88-4d3a-4e57-9816-cad283d2fe7b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:37.136080 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-88fecd88-4d3a-4e57-9816-cad283d2fe7b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:37.136508 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-88fecd88-4d3a-4e57-9816-cad283d2fe7b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:37.217556 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-dc2df62a-8081-42d6-b646-a4372d59818d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:37.218272 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-dc2df62a-8081-42d6-b646-a4372d59818d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:37.224315 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dc2df62a-8081-42d6-b646-a4372d59818d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:37.224754 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dc2df62a-8081-42d6-b646-a4372d59818d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:37.225515 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dc2df62a-8081-42d6-b646-a4372d59818d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:37.225949 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dc2df62a-8081-42d6-b646-a4372d59818d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:37.264148 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-88fecd88-4d3a-4e57-9816-cad283d2fe7b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:37.271668 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-88fecd88-4d3a-4e57-9816-cad283d2fe7b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1521 microversion: 2.1 time: 0.151222 Oct 19 08:28:37.272332 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 435/860] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:37 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:37.351300 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-dc2df62a-8081-42d6-b646-a4372d59818d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:37.358826 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-dc2df62a-8081-42d6-b646-a4372d59818d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:37.360331 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-dc2df62a-8081-42d6-b646-a4372d59818d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:37.361463 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-dc2df62a-8081-42d6-b646-a4372d59818d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1725 microversion: 2.20 time: 0.148021 Oct 19 08:28:37.362011 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 426/861] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:28:37 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:28:37.628140 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-f4c257b8-2c99-48d1-90f1-6823f44fc577 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2045842582", "imageRef": "9102a998-a580-4b4e-b6a1-3172273dd66d", "flavorRef": "452"}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:37.677060 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.network.neutron [None req-f4c257b8-2c99-48d1-90f1-6823f44fc577 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] validate_networks() for None {{(pid=114106) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 19 08:28:38.165803 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-f4c257b8-2c99-48d1-90f1-6823f44fc577 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Flavor limits 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 08:28:38.166365 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-f4c257b8-2c99-48d1-90f1-6823f44fc577 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Image limits 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 08:28:38.166722 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-f4c257b8-2c99-48d1-90f1-6823f44fc577 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Flavor pref 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 08:28:38.167133 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-f4c257b8-2c99-48d1-90f1-6823f44fc577 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Image pref 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 08:28:38.167542 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-f4c257b8-2c99-48d1-90f1-6823f44fc577 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 08:28:38.176575 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f4c257b8-2c99-48d1-90f1-6823f44fc577 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:38.177006 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f4c257b8-2c99-48d1-90f1-6823f44fc577 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:38.177794 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f4c257b8-2c99-48d1-90f1-6823f44fc577 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:38.178220 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f4c257b8-2c99-48d1-90f1-6823f44fc577 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:38.194546 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-f4c257b8-2c99-48d1-90f1-6823f44fc577 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Getting quotas for project 5c07ba81dc364646bfacfb309f6a1b19. Resources: {'cores', 'instances', 'ram'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:28:38.198361 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-f4c257b8-2c99-48d1-90f1-6823f44fc577 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Getting quotas for user 2218e5c14d72437395e0800a182f5e52 and project 5c07ba81dc364646bfacfb309f6a1b19. Resources: {'cores', 'instances', 'ram'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:28:38.208792 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-f4c257b8-2c99-48d1-90f1-6823f44fc577 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Going to run 1 instances... {{(pid=114106) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 19 08:28:38.211072 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-f4c257b8-2c99-48d1-90f1-6823f44fc577 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] [instance: 2fa627cc-cd11-452a-bde6-f942981f8176] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9102a998-a580-4b4e-b6a1-3172273dd66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114106) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 19 08:28:38.253130 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-f4c257b8-2c99-48d1-90f1-6823f44fc577 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.628553 Oct 19 08:28:38.253768 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 436/862] 10.222.0.26 () {60 vars in 1146 bytes} [Tue Oct 19 08:28:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 08:28:38.264318 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-46852ce2-590f-45e9-87f2-e1b44e168854 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:38.264916 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-46852ce2-590f-45e9-87f2-e1b44e168854 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] [instance: 2fa627cc-cd11-452a-bde6-f942981f8176] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:38.288259 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-bdd6ad39-8f90-4510-8d8a-f14aff3a22f9 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:38.288868 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-bdd6ad39-8f90-4510-8d8a-f14aff3a22f9 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:38.294860 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bdd6ad39-8f90-4510-8d8a-f14aff3a22f9 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:38.295307 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bdd6ad39-8f90-4510-8d8a-f14aff3a22f9 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:38.296080 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bdd6ad39-8f90-4510-8d8a-f14aff3a22f9 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:38.296508 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bdd6ad39-8f90-4510-8d8a-f14aff3a22f9 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:38.321249 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-46852ce2-590f-45e9-87f2-e1b44e168854 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2218e5c14d72437395e0800a182f5e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c07ba81dc364646bfacfb309f6a1b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:38.327895 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-46852ce2-590f-45e9-87f2-e1b44e168854 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176" status: 200 len: 1215 microversion: 2.1 time: 0.067244 Oct 19 08:28:38.328678 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 427/863] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:38 2021] GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176 => generated 1215 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:28:38.380896 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-b1c9de1b-ea91-420e-8c76-7593323d5468 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:38.381801 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-b1c9de1b-ea91-420e-8c76-7593323d5468 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:38.388085 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b1c9de1b-ea91-420e-8c76-7593323d5468 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:38.388738 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b1c9de1b-ea91-420e-8c76-7593323d5468 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:38.389506 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b1c9de1b-ea91-420e-8c76-7593323d5468 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:38.389932 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b1c9de1b-ea91-420e-8c76-7593323d5468 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:38.425735 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-bdd6ad39-8f90-4510-8d8a-f14aff3a22f9 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:38.434654 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-bdd6ad39-8f90-4510-8d8a-f14aff3a22f9 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1521 microversion: 2.1 time: 0.149693 Oct 19 08:28:38.435531 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 437/864] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:38 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:28:38.517468 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-b1c9de1b-ea91-420e-8c76-7593323d5468 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:38.525336 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-b1c9de1b-ea91-420e-8c76-7593323d5468 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:38.526887 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-b1c9de1b-ea91-420e-8c76-7593323d5468 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:38.528228 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-b1c9de1b-ea91-420e-8c76-7593323d5468 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1725 microversion: 2.20 time: 0.152869 Oct 19 08:28:38.528785 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 428/865] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:28:38 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:28:39.345528 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-4cec4ad3-33ba-49f4-a3ee-6535c015c55a tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:39.346814 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-4cec4ad3-33ba-49f4-a3ee-6535c015c55a tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] [instance: 2fa627cc-cd11-452a-bde6-f942981f8176] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:39.355361 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4cec4ad3-33ba-49f4-a3ee-6535c015c55a tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:39.356132 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4cec4ad3-33ba-49f4-a3ee-6535c015c55a tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:39.357186 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4cec4ad3-33ba-49f4-a3ee-6535c015c55a tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:39.357939 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4cec4ad3-33ba-49f4-a3ee-6535c015c55a tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:39.452678 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-3c9fc6f9-2446-4a92-a0fe-c396904137a4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:39.453268 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-3c9fc6f9-2446-4a92-a0fe-c396904137a4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:39.455116 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-4cec4ad3-33ba-49f4-a3ee-6535c015c55a tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2218e5c14d72437395e0800a182f5e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c07ba81dc364646bfacfb309f6a1b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:39.462547 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-4cec4ad3-33ba-49f4-a3ee-6535c015c55a tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176" status: 200 len: 1275 microversion: 2.1 time: 0.121107 Oct 19 08:28:39.465608 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3c9fc6f9-2446-4a92-a0fe-c396904137a4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:39.465890 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 438/866] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:39 2021] GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176 => generated 1275 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:39.466090 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3c9fc6f9-2446-4a92-a0fe-c396904137a4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:39.470308 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3c9fc6f9-2446-4a92-a0fe-c396904137a4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:39.470841 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3c9fc6f9-2446-4a92-a0fe-c396904137a4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:39.549153 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-2c100e72-fcaf-4768-8088-89f5a466ac55 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:39.549738 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-2c100e72-fcaf-4768-8088-89f5a466ac55 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:39.559726 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2c100e72-fcaf-4768-8088-89f5a466ac55 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:39.560601 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2c100e72-fcaf-4768-8088-89f5a466ac55 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:39.561645 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2c100e72-fcaf-4768-8088-89f5a466ac55 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:39.563142 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2c100e72-fcaf-4768-8088-89f5a466ac55 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:39.717633 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-3c9fc6f9-2446-4a92-a0fe-c396904137a4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:39.726178 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-3c9fc6f9-2446-4a92-a0fe-c396904137a4 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1521 microversion: 2.1 time: 0.278039 Oct 19 08:28:39.726897 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 429/867] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:39 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:28:39.796835 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-2c100e72-fcaf-4768-8088-89f5a466ac55 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:39.804551 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-2c100e72-fcaf-4768-8088-89f5a466ac55 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:39.806048 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-2c100e72-fcaf-4768-8088-89f5a466ac55 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:39.807331 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-2c100e72-fcaf-4768-8088-89f5a466ac55 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1725 microversion: 2.20 time: 0.262003 Oct 19 08:28:39.807886 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 439/868] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:28:39 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1725 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:28:40.479813 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-1190f0cc-9baf-4511-8579-9697ebc6b27f tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:40.480401 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-1190f0cc-9baf-4511-8579-9697ebc6b27f tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] [instance: 2fa627cc-cd11-452a-bde6-f942981f8176] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:40.486534 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1190f0cc-9baf-4511-8579-9697ebc6b27f tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:40.486975 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1190f0cc-9baf-4511-8579-9697ebc6b27f tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:40.487724 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1190f0cc-9baf-4511-8579-9697ebc6b27f tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:40.488150 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1190f0cc-9baf-4511-8579-9697ebc6b27f tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:40.703627 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-1190f0cc-9baf-4511-8579-9697ebc6b27f tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2218e5c14d72437395e0800a182f5e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c07ba81dc364646bfacfb309f6a1b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:40.710923 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-1190f0cc-9baf-4511-8579-9697ebc6b27f tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176" status: 200 len: 1315 microversion: 2.1 time: 0.234731 Oct 19 08:28:40.711489 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 430/869] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:40 2021] GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:40.742644 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c5b215ff-8cab-4cbe-b244-e553404c0c2d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:40.743472 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c5b215ff-8cab-4cbe-b244-e553404c0c2d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:40.749502 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c5b215ff-8cab-4cbe-b244-e553404c0c2d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:40.750015 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c5b215ff-8cab-4cbe-b244-e553404c0c2d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:40.750889 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c5b215ff-8cab-4cbe-b244-e553404c0c2d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:40.751380 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c5b215ff-8cab-4cbe-b244-e553404c0c2d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:40.828440 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-6e40878f-479d-4fa2-9b74-fbe7f6527e81 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:40.829402 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-6e40878f-479d-4fa2-9b74-fbe7f6527e81 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:40.835882 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6e40878f-479d-4fa2-9b74-fbe7f6527e81 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:40.836533 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6e40878f-479d-4fa2-9b74-fbe7f6527e81 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:40.837458 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6e40878f-479d-4fa2-9b74-fbe7f6527e81 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:40.838199 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6e40878f-479d-4fa2-9b74-fbe7f6527e81 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:41.073099 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-c5b215ff-8cab-4cbe-b244-e553404c0c2d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:41.081272 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c5b215ff-8cab-4cbe-b244-e553404c0c2d tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1521 microversion: 2.1 time: 0.342680 Oct 19 08:28:41.081839 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 440/870] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:40 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:41.121121 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-6e40878f-479d-4fa2-9b74-fbe7f6527e81 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:41.128700 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-6e40878f-479d-4fa2-9b74-fbe7f6527e81 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:41.131576 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-6e40878f-479d-4fa2-9b74-fbe7f6527e81 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:41.132970 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-6e40878f-479d-4fa2-9b74-fbe7f6527e81 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1725 microversion: 2.20 time: 0.311379 Oct 19 08:28:41.133511 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 431/871] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:28:40 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1725 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:28:41.200994 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-8b6f6a93-4d7d-427c-9b08-fc6c42990e06 req-d94047e1-0623-43b4-905b-c04d9bfc0c03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fa627cc-cd11-452a-bde6-f942981f8176", "tag": "25da375e-68a3-4aab-9d7b-2a5b7029e754"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:41.202552 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:28:41.202552 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:28:41.209306 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-8b6f6a93-4d7d-427c-9b08-fc6c42990e06 req-d94047e1-0623-43b4-905b-c04d9bfc0c03 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:41.209730 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-8b6f6a93-4d7d-427c-9b08-fc6c42990e06 req-d94047e1-0623-43b4-905b-c04d9bfc0c03 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:41.220636 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-8b6f6a93-4d7d-427c-9b08-fc6c42990e06 req-d94047e1-0623-43b4-905b-c04d9bfc0c03 service nova] Creating event network-changed:25da375e-68a3-4aab-9d7b-2a5b7029e754 for instance 2fa627cc-cd11-452a-bde6-f942981f8176 on hv-cinder-81398 Oct 19 08:28:41.225698 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-8b6f6a93-4d7d-427c-9b08-fc6c42990e06 req-d94047e1-0623-43b4-905b-c04d9bfc0c03 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028323 Oct 19 08:28:41.226383 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 441/872] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:28:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 08:28:41.729017 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-cff7da54-1d92-43ef-89af-ded5fc0066fe tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:41.729543 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-cff7da54-1d92-43ef-89af-ded5fc0066fe tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] [instance: 2fa627cc-cd11-452a-bde6-f942981f8176] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:41.735358 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cff7da54-1d92-43ef-89af-ded5fc0066fe tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:41.735802 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cff7da54-1d92-43ef-89af-ded5fc0066fe tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:41.736558 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cff7da54-1d92-43ef-89af-ded5fc0066fe tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:41.736988 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cff7da54-1d92-43ef-89af-ded5fc0066fe tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:41.858696 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-cff7da54-1d92-43ef-89af-ded5fc0066fe tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2218e5c14d72437395e0800a182f5e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c07ba81dc364646bfacfb309f6a1b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:41.865937 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-cff7da54-1d92-43ef-89af-ded5fc0066fe tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176" status: 200 len: 1315 microversion: 2.1 time: 0.140646 Oct 19 08:28:41.866518 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 432/873] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:41 2021] GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176 => generated 1315 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:42.099796 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-35ec8a88-2f19-4427-beda-ecded8afc85b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:42.100631 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-35ec8a88-2f19-4427-beda-ecded8afc85b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:42.106532 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-35ec8a88-2f19-4427-beda-ecded8afc85b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:42.106976 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-35ec8a88-2f19-4427-beda-ecded8afc85b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:42.107725 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-35ec8a88-2f19-4427-beda-ecded8afc85b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:42.108148 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-35ec8a88-2f19-4427-beda-ecded8afc85b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:42.151657 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-514ef897-6320-4d91-9f0b-455aa6915103 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:42.152250 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-514ef897-6320-4d91-9f0b-455aa6915103 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:42.157860 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-514ef897-6320-4d91-9f0b-455aa6915103 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:42.158300 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-514ef897-6320-4d91-9f0b-455aa6915103 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:42.159252 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-514ef897-6320-4d91-9f0b-455aa6915103 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:42.159528 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-514ef897-6320-4d91-9f0b-455aa6915103 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:42.253971 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-35ec8a88-2f19-4427-beda-ecded8afc85b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:42.262600 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-35ec8a88-2f19-4427-beda-ecded8afc85b tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1521 microversion: 2.1 time: 0.167351 Oct 19 08:28:42.263201 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 442/874] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:42 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:42.304908 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-514ef897-6320-4d91-9f0b-455aa6915103 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:42.312455 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-514ef897-6320-4d91-9f0b-455aa6915103 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:42.313926 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-514ef897-6320-4d91-9f0b-455aa6915103 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:42.315076 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-514ef897-6320-4d91-9f0b-455aa6915103 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1725 microversion: 2.20 time: 0.167082 Oct 19 08:28:42.315617 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 433/875] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:28:42 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:28:42.882910 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-7a4111b8-3d80-4a0b-ab8e-3f80eb709c26 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:42.883508 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-7a4111b8-3d80-4a0b-ab8e-3f80eb709c26 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] [instance: 2fa627cc-cd11-452a-bde6-f942981f8176] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:42.889281 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7a4111b8-3d80-4a0b-ab8e-3f80eb709c26 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:42.889711 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7a4111b8-3d80-4a0b-ab8e-3f80eb709c26 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:42.890453 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7a4111b8-3d80-4a0b-ab8e-3f80eb709c26 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:42.890907 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7a4111b8-3d80-4a0b-ab8e-3f80eb709c26 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:43.013464 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-7a4111b8-3d80-4a0b-ab8e-3f80eb709c26 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2218e5c14d72437395e0800a182f5e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c07ba81dc364646bfacfb309f6a1b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:43.023394 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-7a4111b8-3d80-4a0b-ab8e-3f80eb709c26 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176" status: 200 len: 1315 microversion: 2.1 time: 0.144527 Oct 19 08:28:43.024612 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 443/876] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:42 2021] GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:43.280558 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-36be2bbd-299d-407b-b76f-c0d1ada41ff7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:43.281105 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-36be2bbd-299d-407b-b76f-c0d1ada41ff7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:43.287480 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-36be2bbd-299d-407b-b76f-c0d1ada41ff7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:43.287925 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-36be2bbd-299d-407b-b76f-c0d1ada41ff7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:43.288682 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-36be2bbd-299d-407b-b76f-c0d1ada41ff7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:43.289114 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-36be2bbd-299d-407b-b76f-c0d1ada41ff7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:43.333304 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-bcc2f4a0-dd7f-4273-8e3f-515ce1adb9e6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:43.334041 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-bcc2f4a0-dd7f-4273-8e3f-515ce1adb9e6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:43.339525 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bcc2f4a0-dd7f-4273-8e3f-515ce1adb9e6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:43.339955 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bcc2f4a0-dd7f-4273-8e3f-515ce1adb9e6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:43.340699 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bcc2f4a0-dd7f-4273-8e3f-515ce1adb9e6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:43.341122 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bcc2f4a0-dd7f-4273-8e3f-515ce1adb9e6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:43.438118 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-36be2bbd-299d-407b-b76f-c0d1ada41ff7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:43.445945 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-36be2bbd-299d-407b-b76f-c0d1ada41ff7 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1521 microversion: 2.1 time: 0.169171 Oct 19 08:28:43.446520 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 434/877] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:43 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:43.486926 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-bcc2f4a0-dd7f-4273-8e3f-515ce1adb9e6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:43.494689 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-bcc2f4a0-dd7f-4273-8e3f-515ce1adb9e6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:43.496174 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-bcc2f4a0-dd7f-4273-8e3f-515ce1adb9e6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:43.497307 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-bcc2f4a0-dd7f-4273-8e3f-515ce1adb9e6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1725 microversion: 2.20 time: 0.168131 Oct 19 08:28:43.497846 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 444/878] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:28:43 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:28:44.041009 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-9c700da4-4be6-470d-a3cc-ae686c7b702a tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:44.041603 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-9c700da4-4be6-470d-a3cc-ae686c7b702a tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] [instance: 2fa627cc-cd11-452a-bde6-f942981f8176] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:44.047826 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9c700da4-4be6-470d-a3cc-ae686c7b702a tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:44.048277 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9c700da4-4be6-470d-a3cc-ae686c7b702a tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:44.049745 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9c700da4-4be6-470d-a3cc-ae686c7b702a tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:44.050178 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9c700da4-4be6-470d-a3cc-ae686c7b702a tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:44.170036 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-9c700da4-4be6-470d-a3cc-ae686c7b702a tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2218e5c14d72437395e0800a182f5e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c07ba81dc364646bfacfb309f6a1b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:44.177668 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-9c700da4-4be6-470d-a3cc-ae686c7b702a tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176" status: 200 len: 1315 microversion: 2.1 time: 0.140503 Oct 19 08:28:44.178212 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 435/879] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:44 2021] GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176 => generated 1315 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:44.461631 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-bfd2fc65-725c-4357-bf0d-0a4884ac2bfb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:44.462264 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-bfd2fc65-725c-4357-bf0d-0a4884ac2bfb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:44.468053 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bfd2fc65-725c-4357-bf0d-0a4884ac2bfb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:44.468490 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bfd2fc65-725c-4357-bf0d-0a4884ac2bfb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:44.469241 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bfd2fc65-725c-4357-bf0d-0a4884ac2bfb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:44.469662 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bfd2fc65-725c-4357-bf0d-0a4884ac2bfb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:44.515212 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-57d88983-ba31-4233-836e-ddcf042322a3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:44.515797 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-57d88983-ba31-4233-836e-ddcf042322a3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:44.521989 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-57d88983-ba31-4233-836e-ddcf042322a3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:44.522431 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-57d88983-ba31-4233-836e-ddcf042322a3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:44.523227 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-57d88983-ba31-4233-836e-ddcf042322a3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:44.523653 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-57d88983-ba31-4233-836e-ddcf042322a3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:44.654117 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-bfd2fc65-725c-4357-bf0d-0a4884ac2bfb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:44.661779 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-bfd2fc65-725c-4357-bf0d-0a4884ac2bfb tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1521 microversion: 2.1 time: 0.203752 Oct 19 08:28:44.662476 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 445/880] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:44 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:44.729090 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-57d88983-ba31-4233-836e-ddcf042322a3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:44.736703 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-57d88983-ba31-4233-836e-ddcf042322a3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:44.738177 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-57d88983-ba31-4233-836e-ddcf042322a3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:44.740339 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-57d88983-ba31-4233-836e-ddcf042322a3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1725 microversion: 2.20 time: 0.228645 Oct 19 08:28:44.740904 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 436/881] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:28:44 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1725 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:28:45.193871 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ec53a932-3003-49c2-915d-81f972eae67d tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:45.194464 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ec53a932-3003-49c2-915d-81f972eae67d tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] [instance: 2fa627cc-cd11-452a-bde6-f942981f8176] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:45.200200 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ec53a932-3003-49c2-915d-81f972eae67d tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:45.200570 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ec53a932-3003-49c2-915d-81f972eae67d tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:45.201357 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ec53a932-3003-49c2-915d-81f972eae67d tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:45.201775 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ec53a932-3003-49c2-915d-81f972eae67d tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:45.397003 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ec53a932-3003-49c2-915d-81f972eae67d tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2218e5c14d72437395e0800a182f5e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c07ba81dc364646bfacfb309f6a1b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:45.404292 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ec53a932-3003-49c2-915d-81f972eae67d tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176" status: 200 len: 1315 microversion: 2.1 time: 0.214473 Oct 19 08:28:45.405052 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 446/882] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:45 2021] GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:45.677838 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-63fd1b72-80c2-4b0f-bcee-4f28e130b068 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:45.678443 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-63fd1b72-80c2-4b0f-bcee-4f28e130b068 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:45.684254 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-63fd1b72-80c2-4b0f-bcee-4f28e130b068 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:45.684702 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-63fd1b72-80c2-4b0f-bcee-4f28e130b068 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:45.685458 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-63fd1b72-80c2-4b0f-bcee-4f28e130b068 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:45.685889 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-63fd1b72-80c2-4b0f-bcee-4f28e130b068 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:45.758784 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-794da8dd-8964-46f4-8bec-9a76f732230c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:45.759318 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-794da8dd-8964-46f4-8bec-9a76f732230c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:45.765164 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-794da8dd-8964-46f4-8bec-9a76f732230c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:45.765610 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-794da8dd-8964-46f4-8bec-9a76f732230c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:45.766369 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-794da8dd-8964-46f4-8bec-9a76f732230c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:45.766821 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-794da8dd-8964-46f4-8bec-9a76f732230c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:45.807491 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-63fd1b72-80c2-4b0f-bcee-4f28e130b068 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:45.816417 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-63fd1b72-80c2-4b0f-bcee-4f28e130b068 tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1521 microversion: 2.1 time: 0.141968 Oct 19 08:28:45.817148 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 437/883] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:45 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:45.893386 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-794da8dd-8964-46f4-8bec-9a76f732230c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:45.901713 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-794da8dd-8964-46f4-8bec-9a76f732230c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:45.903287 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-794da8dd-8964-46f4-8bec-9a76f732230c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:45.904441 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-794da8dd-8964-46f4-8bec-9a76f732230c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1725 microversion: 2.20 time: 0.150209 Oct 19 08:28:45.905204 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 447/884] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:28:45 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:28:46.422322 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d7ecdf81-981b-4b84-9229-c1a706d2761b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:46.423507 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-d7ecdf81-981b-4b84-9229-c1a706d2761b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] [instance: 2fa627cc-cd11-452a-bde6-f942981f8176] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:46.443881 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d7ecdf81-981b-4b84-9229-c1a706d2761b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:46.446764 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d7ecdf81-981b-4b84-9229-c1a706d2761b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:46.459690 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d7ecdf81-981b-4b84-9229-c1a706d2761b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:46.461458 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d7ecdf81-981b-4b84-9229-c1a706d2761b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:46.695966 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-d7ecdf81-981b-4b84-9229-c1a706d2761b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2218e5c14d72437395e0800a182f5e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c07ba81dc364646bfacfb309f6a1b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:46.703130 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-d7ecdf81-981b-4b84-9229-c1a706d2761b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176" status: 200 len: 1315 microversion: 2.1 time: 0.285905 Oct 19 08:28:46.703688 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 438/885] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:46 2021] GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:46.833984 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-464bc598-11e8-49e3-8388-5ddd683abe8f tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:46.834673 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-464bc598-11e8-49e3-8388-5ddd683abe8f tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:46.840466 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-464bc598-11e8-49e3-8388-5ddd683abe8f tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:46.840901 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-464bc598-11e8-49e3-8388-5ddd683abe8f tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:46.841660 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-464bc598-11e8-49e3-8388-5ddd683abe8f tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:46.842086 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-464bc598-11e8-49e3-8388-5ddd683abe8f tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:46.868743 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-91c029c7-234d-484c-b41c-0f7e8ee70b51 req-30a815c5-66b9-4eab-9a1c-172cb6f6474d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a856f6-f552-461f-8d9c-4bf017cbbac5", "name": "network-vif-deleted", "tag": "f6a1d3b0-9ba8-4cd7-b18a-cd9b4d0b1082"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:46.871665 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:28:46.871665 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:28:46.880739 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-91c029c7-234d-484c-b41c-0f7e8ee70b51 req-30a815c5-66b9-4eab-9a1c-172cb6f6474d service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:46.881429 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-91c029c7-234d-484c-b41c-0f7e8ee70b51 req-30a815c5-66b9-4eab-9a1c-172cb6f6474d service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:46.894075 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-91c029c7-234d-484c-b41c-0f7e8ee70b51 req-30a815c5-66b9-4eab-9a1c-172cb6f6474d service nova] Creating event network-vif-deleted:f6a1d3b0-9ba8-4cd7-b18a-cd9b4d0b1082 for instance a2a856f6-f552-461f-8d9c-4bf017cbbac5 on hv-cinder-81398 Oct 19 08:28:46.900627 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-91c029c7-234d-484c-b41c-0f7e8ee70b51 req-30a815c5-66b9-4eab-9a1c-172cb6f6474d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035531 Oct 19 08:28:46.901383 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 439/886] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:28:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 08:28:46.904219 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-464bc598-11e8-49e3-8388-5ddd683abe8f tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7431ad6d854a37a0fc5aa46eb7f29e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656d95cbc7b3437ea618e2224cbbfeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:46.912794 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-464bc598-11e8-49e3-8388-5ddd683abe8f tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 200 len: 1479 microversion: 2.1 time: 0.082733 Oct 19 08:28:46.913356 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 448/887] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:46 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 1479 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:46.922465 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c3313d4a-280d-47dd-897d-87c3db5635f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:46.923158 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-c3313d4a-280d-47dd-897d-87c3db5635f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:46.929686 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c3313d4a-280d-47dd-897d-87c3db5635f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:46.930122 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c3313d4a-280d-47dd-897d-87c3db5635f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:46.930904 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c3313d4a-280d-47dd-897d-87c3db5635f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:46.931329 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c3313d4a-280d-47dd-897d-87c3db5635f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:47.056892 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-c3313d4a-280d-47dd-897d-87c3db5635f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:47.064687 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-c3313d4a-280d-47dd-897d-87c3db5635f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:47.066175 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-c3313d4a-280d-47dd-897d-87c3db5635f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:47.067366 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-c3313d4a-280d-47dd-897d-87c3db5635f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1725 microversion: 2.20 time: 0.148820 Oct 19 08:28:47.067913 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 440/888] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:28:46 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:28:47.303582 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e68e14b2-659f-44ae-be0f-97b64787b1bd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:47.309294 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e68e14b2-659f-44ae-be0f-97b64787b1bd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:47.309736 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e68e14b2-659f-44ae-be0f-97b64787b1bd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:47.368332 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e68e14b2-659f-44ae-be0f-97b64787b1bd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Going to try to stop instance {{(pid=114106) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 19 08:28:47.419332 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e68e14b2-659f-44ae-be0f-97b64787b1bd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 202 len: 0 microversion: 2.1 time: 0.118975 Oct 19 08:28:47.419934 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 449/889] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:28:47 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:28:47.428012 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-28a1cbed-a96b-4c36-876f-1daaa154c4b7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:47.429141 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-28a1cbed-a96b-4c36-876f-1daaa154c4b7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:47.436846 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-28a1cbed-a96b-4c36-876f-1daaa154c4b7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:47.437523 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-28a1cbed-a96b-4c36-876f-1daaa154c4b7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:47.438669 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-28a1cbed-a96b-4c36-876f-1daaa154c4b7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:47.439443 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-28a1cbed-a96b-4c36-876f-1daaa154c4b7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:47.563392 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-28a1cbed-a96b-4c36-876f-1daaa154c4b7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:47.571937 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-28a1cbed-a96b-4c36-876f-1daaa154c4b7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1722 microversion: 2.1 time: 0.147860 Oct 19 08:28:47.572497 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 441/890] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:47 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:47.720356 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-01e334a8-60b6-474e-b215-0fb7e92275c5 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:47.721136 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-01e334a8-60b6-474e-b215-0fb7e92275c5 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] [instance: 2fa627cc-cd11-452a-bde6-f942981f8176] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:47.727539 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-01e334a8-60b6-474e-b215-0fb7e92275c5 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:47.728101 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-01e334a8-60b6-474e-b215-0fb7e92275c5 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:47.728863 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-01e334a8-60b6-474e-b215-0fb7e92275c5 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:47.729219 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-01e334a8-60b6-474e-b215-0fb7e92275c5 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:47.854722 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-01e334a8-60b6-474e-b215-0fb7e92275c5 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2218e5c14d72437395e0800a182f5e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c07ba81dc364646bfacfb309f6a1b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:47.861858 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-01e334a8-60b6-474e-b215-0fb7e92275c5 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176" status: 200 len: 1315 microversion: 2.1 time: 0.145562 Oct 19 08:28:47.862412 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 450/891] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:47 2021] GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:47.929811 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-e3a58f32-7c4a-436b-ab51-718dae366ecf tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:47.930400 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-e3a58f32-7c4a-436b-ab51-718dae366ecf tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] [instance: a2a856f6-f552-461f-8d9c-4bf017cbbac5] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:47.936242 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e3a58f32-7c4a-436b-ab51-718dae366ecf tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:47.936678 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e3a58f32-7c4a-436b-ab51-718dae366ecf tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:47.937424 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e3a58f32-7c4a-436b-ab51-718dae366ecf tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:47.937846 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e3a58f32-7c4a-436b-ab51-718dae366ecf tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:47.950824 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.wsgi [None req-e3a58f32-7c4a-436b-ab51-718dae366ecf tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] HTTP exception thrown: Instance a2a856f6-f552-461f-8d9c-4bf017cbbac5 could not be found. Oct 19 08:28:47.951397 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-e3a58f32-7c4a-436b-ab51-718dae366ecf tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] Returning 404 to user: Instance a2a856f6-f552-461f-8d9c-4bf017cbbac5 could not be found. {{(pid=114105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:28:47.952183 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-e3a58f32-7c4a-436b-ab51-718dae366ecf tempest-ServerRescueNegativeTestJSON-665084525 tempest-ServerRescueNegativeTestJSON-665084525-project] 10.222.0.26 "GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5" status: 404 len: 111 microversion: 2.1 time: 0.026622 Oct 19 08:28:47.952688 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 442/892] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:47 2021] GET /compute/v2.1/servers/a2a856f6-f552-461f-8d9c-4bf017cbbac5 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:28:48.085636 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-57003d68-0217-4800-b2bf-9ff7d1949390 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:48.086268 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-57003d68-0217-4800-b2bf-9ff7d1949390 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:48.092280 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-57003d68-0217-4800-b2bf-9ff7d1949390 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:48.092723 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-57003d68-0217-4800-b2bf-9ff7d1949390 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:48.093502 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-57003d68-0217-4800-b2bf-9ff7d1949390 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:48.093931 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-57003d68-0217-4800-b2bf-9ff7d1949390 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:48.470073 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-57003d68-0217-4800-b2bf-9ff7d1949390 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:48.478435 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-57003d68-0217-4800-b2bf-9ff7d1949390 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:48.480120 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-57003d68-0217-4800-b2bf-9ff7d1949390 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:48.481298 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-57003d68-0217-4800-b2bf-9ff7d1949390 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1725 microversion: 2.20 time: 0.399869 Oct 19 08:28:48.481848 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 451/893] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:28:48 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1725 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:28:48.588971 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d35f2a01-ab55-4deb-bf5b-bf553204a178 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:48.589573 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-d35f2a01-ab55-4deb-bf5b-bf553204a178 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:48.595248 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d35f2a01-ab55-4deb-bf5b-bf553204a178 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:48.595700 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d35f2a01-ab55-4deb-bf5b-bf553204a178 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:48.596462 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d35f2a01-ab55-4deb-bf5b-bf553204a178 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:48.596889 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d35f2a01-ab55-4deb-bf5b-bf553204a178 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:48.855318 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-d35f2a01-ab55-4deb-bf5b-bf553204a178 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:48.863272 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-d35f2a01-ab55-4deb-bf5b-bf553204a178 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1722 microversion: 2.1 time: 0.277888 Oct 19 08:28:48.864200 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 443/894] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:48 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1722 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:48.878360 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-fe2487bb-2754-49fc-890d-216d6a89ecd2 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:48.878987 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-fe2487bb-2754-49fc-890d-216d6a89ecd2 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] [instance: 2fa627cc-cd11-452a-bde6-f942981f8176] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:48.885801 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fe2487bb-2754-49fc-890d-216d6a89ecd2 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:48.886272 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fe2487bb-2754-49fc-890d-216d6a89ecd2 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:48.887059 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fe2487bb-2754-49fc-890d-216d6a89ecd2 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:48.887617 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fe2487bb-2754-49fc-890d-216d6a89ecd2 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:49.072081 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-fe2487bb-2754-49fc-890d-216d6a89ecd2 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2218e5c14d72437395e0800a182f5e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c07ba81dc364646bfacfb309f6a1b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:49.079386 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-fe2487bb-2754-49fc-890d-216d6a89ecd2 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176" status: 200 len: 1315 microversion: 2.1 time: 0.204448 Oct 19 08:28:49.081506 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 452/895] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:48 2021] GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:49.500406 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-40cdd35d-369c-46fc-b25b-783d286d0bcf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:49.501010 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-40cdd35d-369c-46fc-b25b-783d286d0bcf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:49.507107 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-40cdd35d-369c-46fc-b25b-783d286d0bcf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:49.507803 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-40cdd35d-369c-46fc-b25b-783d286d0bcf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:49.508567 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-40cdd35d-369c-46fc-b25b-783d286d0bcf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:49.509004 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-40cdd35d-369c-46fc-b25b-783d286d0bcf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:49.742770 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-40cdd35d-369c-46fc-b25b-783d286d0bcf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:49.750292 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-40cdd35d-369c-46fc-b25b-783d286d0bcf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:49.751980 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-40cdd35d-369c-46fc-b25b-783d286d0bcf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:49.753241 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-40cdd35d-369c-46fc-b25b-783d286d0bcf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1725 microversion: 2.20 time: 0.256452 Oct 19 08:28:49.753791 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 444/896] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:28:49 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1725 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:28:49.880457 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c575b920-bf2b-4bb5-bf49-8d74277018cc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:49.881055 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c575b920-bf2b-4bb5-bf49-8d74277018cc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:49.887022 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c575b920-bf2b-4bb5-bf49-8d74277018cc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:49.887464 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c575b920-bf2b-4bb5-bf49-8d74277018cc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:49.888218 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c575b920-bf2b-4bb5-bf49-8d74277018cc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:49.888641 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c575b920-bf2b-4bb5-bf49-8d74277018cc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:50.096565 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-16e8bdb8-1481-43d4-962b-2ceefb32f292 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:50.097712 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-16e8bdb8-1481-43d4-962b-2ceefb32f292 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] [instance: 2fa627cc-cd11-452a-bde6-f942981f8176] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:50.108054 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-16e8bdb8-1481-43d4-962b-2ceefb32f292 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:50.108700 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-16e8bdb8-1481-43d4-962b-2ceefb32f292 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:50.109627 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-16e8bdb8-1481-43d4-962b-2ceefb32f292 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:50.110221 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-16e8bdb8-1481-43d4-962b-2ceefb32f292 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:50.133278 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-c575b920-bf2b-4bb5-bf49-8d74277018cc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:50.143842 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c575b920-bf2b-4bb5-bf49-8d74277018cc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1722 microversion: 2.1 time: 0.267382 Oct 19 08:28:50.155444 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 453/897] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:49 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1722 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:50.549561 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-16e8bdb8-1481-43d4-962b-2ceefb32f292 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2218e5c14d72437395e0800a182f5e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c07ba81dc364646bfacfb309f6a1b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:50.557783 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-16e8bdb8-1481-43d4-962b-2ceefb32f292 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176" status: 200 len: 1315 microversion: 2.1 time: 0.464681 Oct 19 08:28:50.558341 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 445/898] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:50 2021] GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176 => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:28:50.772838 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-43c8ad68-4cdb-4395-a52b-97bbc61dd35e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:50.773475 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-43c8ad68-4cdb-4395-a52b-97bbc61dd35e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:50.779280 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-43c8ad68-4cdb-4395-a52b-97bbc61dd35e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:50.779719 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-43c8ad68-4cdb-4395-a52b-97bbc61dd35e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:50.780475 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-43c8ad68-4cdb-4395-a52b-97bbc61dd35e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:50.780893 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-43c8ad68-4cdb-4395-a52b-97bbc61dd35e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:51.055789 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-43c8ad68-4cdb-4395-a52b-97bbc61dd35e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:51.063478 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-43c8ad68-4cdb-4395-a52b-97bbc61dd35e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:51.065013 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-43c8ad68-4cdb-4395-a52b-97bbc61dd35e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:51.066099 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-43c8ad68-4cdb-4395-a52b-97bbc61dd35e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1725 microversion: 2.20 time: 0.297840 Oct 19 08:28:51.066756 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 454/899] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:28:50 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1725 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:28:51.161786 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-f78b0851-ea06-42a9-8f07-78440e59d75b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:51.162468 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-f78b0851-ea06-42a9-8f07-78440e59d75b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:51.169524 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f78b0851-ea06-42a9-8f07-78440e59d75b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:51.170075 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f78b0851-ea06-42a9-8f07-78440e59d75b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:51.170932 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f78b0851-ea06-42a9-8f07-78440e59d75b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:51.171360 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f78b0851-ea06-42a9-8f07-78440e59d75b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:51.387416 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-f78b0851-ea06-42a9-8f07-78440e59d75b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:51.396242 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-f78b0851-ea06-42a9-8f07-78440e59d75b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1722 microversion: 2.1 time: 0.238763 Oct 19 08:28:51.396814 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 446/900] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:51 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:51.573555 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-19ac56e6-bc55-485e-82fd-08f772df86eb tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:51.574152 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-19ac56e6-bc55-485e-82fd-08f772df86eb tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] [instance: 2fa627cc-cd11-452a-bde6-f942981f8176] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:51.580070 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-19ac56e6-bc55-485e-82fd-08f772df86eb tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:51.580509 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-19ac56e6-bc55-485e-82fd-08f772df86eb tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:51.581481 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-19ac56e6-bc55-485e-82fd-08f772df86eb tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:51.581655 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-19ac56e6-bc55-485e-82fd-08f772df86eb tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:51.813154 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-19ac56e6-bc55-485e-82fd-08f772df86eb tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2218e5c14d72437395e0800a182f5e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c07ba81dc364646bfacfb309f6a1b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:51.826138 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-19ac56e6-bc55-485e-82fd-08f772df86eb tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176" status: 200 len: 1315 microversion: 2.1 time: 0.256069 Oct 19 08:28:51.826911 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 455/901] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:51 2021] GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:52.085013 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-f48a3e14-5358-454e-ba09-44bf3005c5d1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:52.085559 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-f48a3e14-5358-454e-ba09-44bf3005c5d1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:52.092732 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f48a3e14-5358-454e-ba09-44bf3005c5d1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:52.093172 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f48a3e14-5358-454e-ba09-44bf3005c5d1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:52.094121 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f48a3e14-5358-454e-ba09-44bf3005c5d1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:52.094579 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f48a3e14-5358-454e-ba09-44bf3005c5d1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:52.303743 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-f48a3e14-5358-454e-ba09-44bf3005c5d1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:52.311909 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-f48a3e14-5358-454e-ba09-44bf3005c5d1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:52.313390 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-f48a3e14-5358-454e-ba09-44bf3005c5d1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:52.314579 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-f48a3e14-5358-454e-ba09-44bf3005c5d1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1725 microversion: 2.20 time: 0.233964 Oct 19 08:28:52.315667 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 447/902] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:28:52 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:28:52.414719 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-550a9c3a-6f79-472e-b231-f42f5d809711 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:52.416045 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-550a9c3a-6f79-472e-b231-f42f5d809711 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:52.421659 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-550a9c3a-6f79-472e-b231-f42f5d809711 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:52.422098 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-550a9c3a-6f79-472e-b231-f42f5d809711 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:52.422878 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-550a9c3a-6f79-472e-b231-f42f5d809711 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:52.423293 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-550a9c3a-6f79-472e-b231-f42f5d809711 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:52.552648 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-550a9c3a-6f79-472e-b231-f42f5d809711 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:52.560496 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-550a9c3a-6f79-472e-b231-f42f5d809711 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1722 microversion: 2.1 time: 0.150447 Oct 19 08:28:52.561060 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 456/903] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:52 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:52.843834 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-812d163c-019d-4a66-8c4f-e37ad2f9bfba tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:52.844444 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-812d163c-019d-4a66-8c4f-e37ad2f9bfba tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] [instance: 2fa627cc-cd11-452a-bde6-f942981f8176] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:52.850763 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-812d163c-019d-4a66-8c4f-e37ad2f9bfba tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:52.851416 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-812d163c-019d-4a66-8c4f-e37ad2f9bfba tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:52.852461 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-812d163c-019d-4a66-8c4f-e37ad2f9bfba tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:52.852895 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-812d163c-019d-4a66-8c4f-e37ad2f9bfba tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:52.978148 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-812d163c-019d-4a66-8c4f-e37ad2f9bfba tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2218e5c14d72437395e0800a182f5e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c07ba81dc364646bfacfb309f6a1b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:52.985374 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-812d163c-019d-4a66-8c4f-e37ad2f9bfba tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176" status: 200 len: 1315 microversion: 2.1 time: 0.145478 Oct 19 08:28:52.985919 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 448/904] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:52 2021] GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:53.336289 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a010d566-bf00-4e6b-942e-01cd59921401 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:53.337143 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a010d566-bf00-4e6b-942e-01cd59921401 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:53.343602 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a010d566-bf00-4e6b-942e-01cd59921401 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:53.344118 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a010d566-bf00-4e6b-942e-01cd59921401 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:53.345525 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a010d566-bf00-4e6b-942e-01cd59921401 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:53.347286 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a010d566-bf00-4e6b-942e-01cd59921401 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:53.489482 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a010d566-bf00-4e6b-942e-01cd59921401 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:53.499246 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a010d566-bf00-4e6b-942e-01cd59921401 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:53.500959 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a010d566-bf00-4e6b-942e-01cd59921401 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:53.502094 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a010d566-bf00-4e6b-942e-01cd59921401 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1725 microversion: 2.20 time: 0.170844 Oct 19 08:28:53.502663 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 457/905] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:28:53 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:28:53.576749 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c91a467f-914f-4697-99db-d9181ba4b455 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:53.577356 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-c91a467f-914f-4697-99db-d9181ba4b455 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:53.583106 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c91a467f-914f-4697-99db-d9181ba4b455 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:53.583548 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c91a467f-914f-4697-99db-d9181ba4b455 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:53.584312 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c91a467f-914f-4697-99db-d9181ba4b455 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:53.584740 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c91a467f-914f-4697-99db-d9181ba4b455 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:53.728244 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-c91a467f-914f-4697-99db-d9181ba4b455 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:53.736252 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-c91a467f-914f-4697-99db-d9181ba4b455 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1722 microversion: 2.1 time: 0.163040 Oct 19 08:28:53.736805 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 449/906] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:53 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:54.002896 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-8da5aa52-6fd8-4f9c-becb-961432a074a2 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:54.003486 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-8da5aa52-6fd8-4f9c-becb-961432a074a2 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] [instance: 2fa627cc-cd11-452a-bde6-f942981f8176] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:54.010936 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8da5aa52-6fd8-4f9c-becb-961432a074a2 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:54.011414 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8da5aa52-6fd8-4f9c-becb-961432a074a2 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:54.012173 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8da5aa52-6fd8-4f9c-becb-961432a074a2 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:54.012590 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8da5aa52-6fd8-4f9c-becb-961432a074a2 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:54.177337 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-8da5aa52-6fd8-4f9c-becb-961432a074a2 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2218e5c14d72437395e0800a182f5e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c07ba81dc364646bfacfb309f6a1b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:54.184816 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-8da5aa52-6fd8-4f9c-becb-961432a074a2 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176" status: 200 len: 1315 microversion: 2.1 time: 0.185518 Oct 19 08:28:54.185460 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 458/907] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:53 2021] GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:54.521231 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-189334e8-592d-40b3-8a42-a83bf4b69c6b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:54.521829 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-189334e8-592d-40b3-8a42-a83bf4b69c6b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:54.527799 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-189334e8-592d-40b3-8a42-a83bf4b69c6b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:54.528426 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-189334e8-592d-40b3-8a42-a83bf4b69c6b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:54.529198 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-189334e8-592d-40b3-8a42-a83bf4b69c6b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:54.529629 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-189334e8-592d-40b3-8a42-a83bf4b69c6b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:54.659196 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-189334e8-592d-40b3-8a42-a83bf4b69c6b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:54.668172 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-189334e8-592d-40b3-8a42-a83bf4b69c6b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:54.669572 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-189334e8-592d-40b3-8a42-a83bf4b69c6b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:54.670733 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-189334e8-592d-40b3-8a42-a83bf4b69c6b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1725 microversion: 2.20 time: 0.153656 Oct 19 08:28:54.671275 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 450/908] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:28:54 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:28:54.752949 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-0cc7a05e-1686-4a83-946c-687eaf762436 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:54.753686 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-0cc7a05e-1686-4a83-946c-687eaf762436 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:54.760405 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0cc7a05e-1686-4a83-946c-687eaf762436 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:54.761056 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0cc7a05e-1686-4a83-946c-687eaf762436 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:54.761687 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0cc7a05e-1686-4a83-946c-687eaf762436 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:54.762117 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0cc7a05e-1686-4a83-946c-687eaf762436 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:54.954886 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-0cc7a05e-1686-4a83-946c-687eaf762436 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:54.963005 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-0cc7a05e-1686-4a83-946c-687eaf762436 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1722 microversion: 2.1 time: 0.213709 Oct 19 08:28:54.964039 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 459/909] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:54 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:55.201798 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-ee6beec3-8e7f-4cca-b537-f6d5afae5d2b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:55.202399 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-ee6beec3-8e7f-4cca-b537-f6d5afae5d2b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] [instance: 2fa627cc-cd11-452a-bde6-f942981f8176] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:55.208859 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ee6beec3-8e7f-4cca-b537-f6d5afae5d2b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:55.209521 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ee6beec3-8e7f-4cca-b537-f6d5afae5d2b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:55.210066 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ee6beec3-8e7f-4cca-b537-f6d5afae5d2b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:55.210513 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ee6beec3-8e7f-4cca-b537-f6d5afae5d2b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:55.354450 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-ee6beec3-8e7f-4cca-b537-f6d5afae5d2b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2218e5c14d72437395e0800a182f5e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c07ba81dc364646bfacfb309f6a1b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:55.361760 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-ee6beec3-8e7f-4cca-b537-f6d5afae5d2b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176" status: 200 len: 1315 microversion: 2.1 time: 0.163701 Oct 19 08:28:55.362320 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 451/910] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:55 2021] GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:55.514527 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-8a4de070-32b1-4815-ae9d-59bdd96cc32b req-14137627-95c9-4440-a6d7-bba67be08039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fa627cc-cd11-452a-bde6-f942981f8176", "name": "network-vif-plugged", "status": "completed", "tag": "25da375e-68a3-4aab-9d7b-2a5b7029e754"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:28:55.516400 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:28:55.516400 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:28:55.529205 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-8a4de070-32b1-4815-ae9d-59bdd96cc32b req-14137627-95c9-4440-a6d7-bba67be08039 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:55.529867 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-8a4de070-32b1-4815-ae9d-59bdd96cc32b req-14137627-95c9-4440-a6d7-bba67be08039 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:55.562367 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-8a4de070-32b1-4815-ae9d-59bdd96cc32b req-14137627-95c9-4440-a6d7-bba67be08039 service nova] Creating event network-vif-plugged:25da375e-68a3-4aab-9d7b-2a5b7029e754 for instance 2fa627cc-cd11-452a-bde6-f942981f8176 on hv-cinder-81398 Oct 19 08:28:55.568405 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-8a4de070-32b1-4815-ae9d-59bdd96cc32b req-14137627-95c9-4440-a6d7-bba67be08039 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057288 Oct 19 08:28:55.569132 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 460/911] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:28:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:28:55.690041 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-4c5f0796-370a-4eac-9edd-62bcd6a00510 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:55.691256 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-4c5f0796-370a-4eac-9edd-62bcd6a00510 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:55.697711 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4c5f0796-370a-4eac-9edd-62bcd6a00510 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:55.698387 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4c5f0796-370a-4eac-9edd-62bcd6a00510 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:55.699776 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4c5f0796-370a-4eac-9edd-62bcd6a00510 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:55.700210 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4c5f0796-370a-4eac-9edd-62bcd6a00510 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:55.902071 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-4c5f0796-370a-4eac-9edd-62bcd6a00510 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:55.910717 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-4c5f0796-370a-4eac-9edd-62bcd6a00510 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:55.912571 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-4c5f0796-370a-4eac-9edd-62bcd6a00510 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:55.913854 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-4c5f0796-370a-4eac-9edd-62bcd6a00510 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1725 microversion: 2.20 time: 0.228098 Oct 19 08:28:55.914537 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 452/912] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:28:55 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1725 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:28:55.982138 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-7d962b81-80ab-4298-99e0-167f922817f7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:55.983212 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-7d962b81-80ab-4298-99e0-167f922817f7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:55.990786 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7d962b81-80ab-4298-99e0-167f922817f7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:55.991236 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7d962b81-80ab-4298-99e0-167f922817f7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:55.992012 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7d962b81-80ab-4298-99e0-167f922817f7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:55.992446 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7d962b81-80ab-4298-99e0-167f922817f7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:56.165048 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-7d962b81-80ab-4298-99e0-167f922817f7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:56.177274 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-7d962b81-80ab-4298-99e0-167f922817f7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1722 microversion: 2.1 time: 0.199380 Oct 19 08:28:56.178838 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 461/913] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:55 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:56.383210 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-f1ea4146-fdc7-48b4-9792-4f6982981061 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:56.383991 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-f1ea4146-fdc7-48b4-9792-4f6982981061 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] [instance: 2fa627cc-cd11-452a-bde6-f942981f8176] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:56.390256 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f1ea4146-fdc7-48b4-9792-4f6982981061 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:56.390897 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f1ea4146-fdc7-48b4-9792-4f6982981061 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:56.391934 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f1ea4146-fdc7-48b4-9792-4f6982981061 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:56.392464 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f1ea4146-fdc7-48b4-9792-4f6982981061 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:56.613171 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-f1ea4146-fdc7-48b4-9792-4f6982981061 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2218e5c14d72437395e0800a182f5e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c07ba81dc364646bfacfb309f6a1b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:56.626674 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-f1ea4146-fdc7-48b4-9792-4f6982981061 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176" status: 200 len: 1315 microversion: 2.1 time: 0.250449 Oct 19 08:28:56.635134 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 453/914] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:56 2021] GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:56.933691 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-41e79011-8737-40f0-8fe4-6f5df69ead9e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:56.935325 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-41e79011-8737-40f0-8fe4-6f5df69ead9e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:56.943740 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-41e79011-8737-40f0-8fe4-6f5df69ead9e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:56.945055 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-41e79011-8737-40f0-8fe4-6f5df69ead9e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:56.946095 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-41e79011-8737-40f0-8fe4-6f5df69ead9e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:56.946834 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-41e79011-8737-40f0-8fe4-6f5df69ead9e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:57.091432 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-41e79011-8737-40f0-8fe4-6f5df69ead9e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:57.100283 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-41e79011-8737-40f0-8fe4-6f5df69ead9e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:57.101795 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-41e79011-8737-40f0-8fe4-6f5df69ead9e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:57.102996 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-41e79011-8737-40f0-8fe4-6f5df69ead9e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1746 microversion: 2.20 time: 0.173630 Oct 19 08:28:57.103713 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 462/915] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:28:56 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1746 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:28:57.189782 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-264e32bc-a0e8-4d55-8d93-815c699a04ba tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:57.191081 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-264e32bc-a0e8-4d55-8d93-815c699a04ba tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: ee918319-a52e-42ad-be1f-026c3f704860] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:57.197125 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-064d1fc3-5928-4cda-b177-104331101be1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:57.198145 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-264e32bc-a0e8-4d55-8d93-815c699a04ba tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:57.198475 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-064d1fc3-5928-4cda-b177-104331101be1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:57.198612 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-264e32bc-a0e8-4d55-8d93-815c699a04ba tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:57.199349 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-264e32bc-a0e8-4d55-8d93-815c699a04ba tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:57.199930 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-264e32bc-a0e8-4d55-8d93-815c699a04ba tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:57.205294 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-064d1fc3-5928-4cda-b177-104331101be1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:57.205891 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-064d1fc3-5928-4cda-b177-104331101be1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:57.207151 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-064d1fc3-5928-4cda-b177-104331101be1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:57.208406 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-064d1fc3-5928-4cda-b177-104331101be1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:57.292221 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.objects.instance [None req-264e32bc-a0e8-4d55-8d93-815c699a04ba tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lazy-loading 'services' on Instance uuid ee918319-a52e-42ad-be1f-026c3f704860 {{(pid=114105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 19 08:28:57.383019 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-264e32bc-a0e8-4d55-8d93-815c699a04ba tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860/os-volume_attachments/74db349b-79ab-4de2-b217-6d5148fd71be" status: 202 len: 0 microversion: 2.1 time: 0.196376 Oct 19 08:28:57.384517 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 454/916] 10.222.0.26 () {58 vars in 1415 bytes} [Tue Oct 19 08:28:57 2021] DELETE /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860/os-volume_attachments/74db349b-79ab-4de2-b217-6d5148fd71be => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:28:57.386178 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-064d1fc3-5928-4cda-b177-104331101be1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:57.398125 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-064d1fc3-5928-4cda-b177-104331101be1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1722 microversion: 2.1 time: 0.207241 Oct 19 08:28:57.409306 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 463/917] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:57 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:28:57.646034 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-68b47875-0408-4ed0-b472-34722619af1b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:57.647570 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-68b47875-0408-4ed0-b472-34722619af1b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] [instance: 2fa627cc-cd11-452a-bde6-f942981f8176] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:57.653524 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-68b47875-0408-4ed0-b472-34722619af1b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:57.653968 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-68b47875-0408-4ed0-b472-34722619af1b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:57.654781 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-68b47875-0408-4ed0-b472-34722619af1b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:57.655559 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-68b47875-0408-4ed0-b472-34722619af1b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:57.834898 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-68b47875-0408-4ed0-b472-34722619af1b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2218e5c14d72437395e0800a182f5e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c07ba81dc364646bfacfb309f6a1b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:57.843135 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-68b47875-0408-4ed0-b472-34722619af1b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176" status: 200 len: 1315 microversion: 2.1 time: 0.201985 Oct 19 08:28:57.844128 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 455/918] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:57 2021] GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:58.121999 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-26e10c74-1cb7-44f2-9381-ff9ab74dddf8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:58.122862 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-26e10c74-1cb7-44f2-9381-ff9ab74dddf8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:58.130917 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-26e10c74-1cb7-44f2-9381-ff9ab74dddf8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:58.131868 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-26e10c74-1cb7-44f2-9381-ff9ab74dddf8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:58.133337 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-26e10c74-1cb7-44f2-9381-ff9ab74dddf8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:58.133974 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-26e10c74-1cb7-44f2-9381-ff9ab74dddf8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:58.295250 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-26e10c74-1cb7-44f2-9381-ff9ab74dddf8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:58.303746 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-26e10c74-1cb7-44f2-9381-ff9ab74dddf8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:58.305223 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-26e10c74-1cb7-44f2-9381-ff9ab74dddf8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:58.306389 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-26e10c74-1cb7-44f2-9381-ff9ab74dddf8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1746 microversion: 2.20 time: 0.188665 Oct 19 08:28:58.306979 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 464/919] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:28:58 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1746 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:28:58.417842 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-b28d6f62-02c7-4297-a209-116ceb3dafab tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:58.419643 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-b28d6f62-02c7-4297-a209-116ceb3dafab tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:58.428002 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b28d6f62-02c7-4297-a209-116ceb3dafab tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:58.428686 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b28d6f62-02c7-4297-a209-116ceb3dafab tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:58.430444 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b28d6f62-02c7-4297-a209-116ceb3dafab tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:58.431391 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b28d6f62-02c7-4297-a209-116ceb3dafab tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:58.514382 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-af4d69af-7386-46d7-b903-2af9559d4ef0 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:58.515089 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-af4d69af-7386-46d7-b903-2af9559d4ef0 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: ee918319-a52e-42ad-be1f-026c3f704860] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:58.522037 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-af4d69af-7386-46d7-b903-2af9559d4ef0 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:58.522894 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-af4d69af-7386-46d7-b903-2af9559d4ef0 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:58.523829 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-af4d69af-7386-46d7-b903-2af9559d4ef0 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:58.524408 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-af4d69af-7386-46d7-b903-2af9559d4ef0 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:58.562740 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-af4d69af-7386-46d7-b903-2af9559d4ef0 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: ee918319-a52e-42ad-be1f-026c3f704860] Going to try to terminate instance {{(pid=114106) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 19 08:28:58.578408 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-b28d6f62-02c7-4297-a209-116ceb3dafab tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:58.587388 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-b28d6f62-02c7-4297-a209-116ceb3dafab tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1722 microversion: 2.1 time: 0.175367 Oct 19 08:28:58.598178 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 456/920] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:58 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:28:58.658400 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-af4d69af-7386-46d7-b903-2af9559d4ef0 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860" status: 204 len: 0 microversion: 2.1 time: 0.147227 Oct 19 08:28:58.659170 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 465/921] 10.222.0.26 () {58 vars in 1238 bytes} [Tue Oct 19 08:28:58 2021] DELETE /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 08:28:58.668570 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-4349ea4e-ebea-4ae3-b571-e02ffd6713e7 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:58.669193 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-4349ea4e-ebea-4ae3-b571-e02ffd6713e7 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: ee918319-a52e-42ad-be1f-026c3f704860] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:58.674939 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4349ea4e-ebea-4ae3-b571-e02ffd6713e7 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:58.675385 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4349ea4e-ebea-4ae3-b571-e02ffd6713e7 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:58.676455 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4349ea4e-ebea-4ae3-b571-e02ffd6713e7 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:58.676894 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4349ea4e-ebea-4ae3-b571-e02ffd6713e7 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:58.861587 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-4349ea4e-ebea-4ae3-b571-e02ffd6713e7 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:58.861970 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a281d3db-8865-47e5-9058-c1c98254a565 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:58.862875 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a281d3db-8865-47e5-9058-c1c98254a565 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] [instance: 2fa627cc-cd11-452a-bde6-f942981f8176] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:58.870861 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-4349ea4e-ebea-4ae3-b571-e02ffd6713e7 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860" status: 200 len: 1512 microversion: 2.1 time: 0.206776 Oct 19 08:28:58.871455 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 457/922] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:58 2021] GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860 => generated 1512 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:58.871890 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a281d3db-8865-47e5-9058-c1c98254a565 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:58.872580 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a281d3db-8865-47e5-9058-c1c98254a565 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:58.873460 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a281d3db-8865-47e5-9058-c1c98254a565 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:58.873978 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a281d3db-8865-47e5-9058-c1c98254a565 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:59.084317 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a281d3db-8865-47e5-9058-c1c98254a565 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2218e5c14d72437395e0800a182f5e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c07ba81dc364646bfacfb309f6a1b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:59.094405 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a281d3db-8865-47e5-9058-c1c98254a565 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176" status: 200 len: 1465 microversion: 2.1 time: 0.234608 Oct 19 08:28:59.094405 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 466/923] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:58 2021] GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176 => generated 1465 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:28:59.128572 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-dae9563c-d87d-47f6-a009-218cf0d87f0b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:59.129107 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-dae9563c-d87d-47f6-a009-218cf0d87f0b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] [instance: 2fa627cc-cd11-452a-bde6-f942981f8176] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:59.135136 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dae9563c-d87d-47f6-a009-218cf0d87f0b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:59.135581 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dae9563c-d87d-47f6-a009-218cf0d87f0b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:59.136373 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dae9563c-d87d-47f6-a009-218cf0d87f0b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:59.136806 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dae9563c-d87d-47f6-a009-218cf0d87f0b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:59.162535 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-dae9563c-d87d-47f6-a009-218cf0d87f0b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] [instance: 2fa627cc-cd11-452a-bde6-f942981f8176] Going to try to terminate instance {{(pid=114105) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 19 08:28:59.238221 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-dae9563c-d87d-47f6-a009-218cf0d87f0b tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176" status: 204 len: 0 microversion: 2.1 time: 0.112780 Oct 19 08:28:59.241432 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 458/924] 10.222.0.26 () {58 vars in 1238 bytes} [Tue Oct 19 08:28:59 2021] DELETE /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 08:28:59.249303 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-5d2c7082-4b07-4a3f-b065-be2bd7ee773c tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:59.249903 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-5d2c7082-4b07-4a3f-b065-be2bd7ee773c tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] [instance: 2fa627cc-cd11-452a-bde6-f942981f8176] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:59.255726 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5d2c7082-4b07-4a3f-b065-be2bd7ee773c tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:59.256166 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5d2c7082-4b07-4a3f-b065-be2bd7ee773c tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:59.256919 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5d2c7082-4b07-4a3f-b065-be2bd7ee773c tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:59.257342 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5d2c7082-4b07-4a3f-b065-be2bd7ee773c tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:59.324766 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-af6f8f78-71a6-41ae-87dc-51f24559be12 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:59.325594 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-af6f8f78-71a6-41ae-87dc-51f24559be12 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:59.331409 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-af6f8f78-71a6-41ae-87dc-51f24559be12 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:59.331855 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-af6f8f78-71a6-41ae-87dc-51f24559be12 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:59.333464 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-af6f8f78-71a6-41ae-87dc-51f24559be12 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:59.334096 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-af6f8f78-71a6-41ae-87dc-51f24559be12 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:59.502860 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-5d2c7082-4b07-4a3f-b065-be2bd7ee773c tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2218e5c14d72437395e0800a182f5e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c07ba81dc364646bfacfb309f6a1b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:59.510924 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-5d2c7082-4b07-4a3f-b065-be2bd7ee773c tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176" status: 200 len: 1471 microversion: 2.1 time: 0.265048 Oct 19 08:28:59.511916 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 467/925] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:59 2021] GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176 => generated 1471 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:59.549615 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-af6f8f78-71a6-41ae-87dc-51f24559be12 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:59.562221 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-af6f8f78-71a6-41ae-87dc-51f24559be12 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:59.563863 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-af6f8f78-71a6-41ae-87dc-51f24559be12 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:59.565259 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-af6f8f78-71a6-41ae-87dc-51f24559be12 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1746 microversion: 2.20 time: 0.244803 Oct 19 08:28:59.566012 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 459/926] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:28:59 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1746 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:28:59.605263 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-be80493d-1ad1-4348-8256-3d502becb420 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:59.605875 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-be80493d-1ad1-4348-8256-3d502becb420 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:59.611566 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-be80493d-1ad1-4348-8256-3d502becb420 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:59.612012 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-be80493d-1ad1-4348-8256-3d502becb420 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:59.613003 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-be80493d-1ad1-4348-8256-3d502becb420 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:59.614010 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-be80493d-1ad1-4348-8256-3d502becb420 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:59.791656 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-be80493d-1ad1-4348-8256-3d502becb420 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:28:59.799224 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-be80493d-1ad1-4348-8256-3d502becb420 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1722 microversion: 2.1 time: 0.197722 Oct 19 08:28:59.799843 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 468/927] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:59 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:28:59.895555 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-884e03f2-c83f-476a-ae86-9d4cfc93d343 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:28:59.897265 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-884e03f2-c83f-476a-ae86-9d4cfc93d343 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: ee918319-a52e-42ad-be1f-026c3f704860] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:28:59.912245 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-884e03f2-c83f-476a-ae86-9d4cfc93d343 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:59.914082 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-884e03f2-c83f-476a-ae86-9d4cfc93d343 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:28:59.915339 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-884e03f2-c83f-476a-ae86-9d4cfc93d343 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:28:59.915987 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-884e03f2-c83f-476a-ae86-9d4cfc93d343 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:00.047231 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-884e03f2-c83f-476a-ae86-9d4cfc93d343 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:00.055399 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-884e03f2-c83f-476a-ae86-9d4cfc93d343 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860" status: 200 len: 1512 microversion: 2.1 time: 0.170553 Oct 19 08:29:00.056156 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 460/928] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:28:59 2021] GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860 => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:29:00.528511 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-7edca0b3-63d7-4dc7-ac01-3c1c87d27160 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:00.529114 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-7edca0b3-63d7-4dc7-ac01-3c1c87d27160 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] [instance: 2fa627cc-cd11-452a-bde6-f942981f8176] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:00.534859 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7edca0b3-63d7-4dc7-ac01-3c1c87d27160 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:00.536035 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7edca0b3-63d7-4dc7-ac01-3c1c87d27160 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:00.536832 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7edca0b3-63d7-4dc7-ac01-3c1c87d27160 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:00.537254 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7edca0b3-63d7-4dc7-ac01-3c1c87d27160 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:00.584724 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d3366dd3-2524-4b3b-b224-775e3a583348 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:00.585590 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-d3366dd3-2524-4b3b-b224-775e3a583348 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:00.591536 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d3366dd3-2524-4b3b-b224-775e3a583348 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:00.592057 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d3366dd3-2524-4b3b-b224-775e3a583348 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:00.592903 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d3366dd3-2524-4b3b-b224-775e3a583348 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:00.593401 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d3366dd3-2524-4b3b-b224-775e3a583348 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:00.693069 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-7edca0b3-63d7-4dc7-ac01-3c1c87d27160 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2218e5c14d72437395e0800a182f5e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c07ba81dc364646bfacfb309f6a1b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:00.701622 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-7edca0b3-63d7-4dc7-ac01-3c1c87d27160 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176" status: 200 len: 1471 microversion: 2.1 time: 0.176948 Oct 19 08:29:00.702294 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 469/929] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:29:00 2021] GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176 => generated 1471 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:29:00.740143 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-d3366dd3-2524-4b3b-b224-775e3a583348 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:00.747832 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-d3366dd3-2524-4b3b-b224-775e3a583348 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:00.749314 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-d3366dd3-2524-4b3b-b224-775e3a583348 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:00.750459 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-d3366dd3-2524-4b3b-b224-775e3a583348 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1746 microversion: 2.20 time: 0.170484 Oct 19 08:29:00.751031 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 461/930] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:00 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1746 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:29:00.818373 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a55d4fcf-25b7-41d6-8616-08735444f486 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:00.819478 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a55d4fcf-25b7-41d6-8616-08735444f486 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:00.826436 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a55d4fcf-25b7-41d6-8616-08735444f486 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:00.826923 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a55d4fcf-25b7-41d6-8616-08735444f486 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:00.827696 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a55d4fcf-25b7-41d6-8616-08735444f486 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:00.828127 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a55d4fcf-25b7-41d6-8616-08735444f486 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:01.035591 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a55d4fcf-25b7-41d6-8616-08735444f486 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:01.045489 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a55d4fcf-25b7-41d6-8616-08735444f486 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1722 microversion: 2.1 time: 0.232270 Oct 19 08:29:01.055594 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 470/931] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:29:00 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:29:01.073735 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-a3a9e011-9ed7-4729-9732-17b8cdeede70 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:01.074613 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-a3a9e011-9ed7-4729-9732-17b8cdeede70 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: ee918319-a52e-42ad-be1f-026c3f704860] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:01.080754 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a3a9e011-9ed7-4729-9732-17b8cdeede70 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:01.081429 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a3a9e011-9ed7-4729-9732-17b8cdeede70 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:01.083604 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a3a9e011-9ed7-4729-9732-17b8cdeede70 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:01.084042 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a3a9e011-9ed7-4729-9732-17b8cdeede70 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:01.584593 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-f1e9127c-64ef-41a7-b392-6c29427555bf req-b5b9a31b-e6f9-4d72-9dc6-2db1a9c05a91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7dae80-4592-45ea-a52d-05aa559c102a", "name": "network-vif-plugged", "status": "completed", "tag": "3ccfabb1-82b3-4904-a943-c29622e0b546"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:29:01.586832 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:29:01.586832 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:29:01.601487 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-a3a9e011-9ed7-4729-9732-17b8cdeede70 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:01.602339 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-f1e9127c-64ef-41a7-b392-6c29427555bf req-b5b9a31b-e6f9-4d72-9dc6-2db1a9c05a91 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:01.603085 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-f1e9127c-64ef-41a7-b392-6c29427555bf req-b5b9a31b-e6f9-4d72-9dc6-2db1a9c05a91 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:01.615247 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-a3a9e011-9ed7-4729-9732-17b8cdeede70 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860" status: 200 len: 1512 microversion: 2.1 time: 0.545842 Oct 19 08:29:01.616141 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 462/932] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:29:01 2021] GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860 => generated 1512 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:29:01.631410 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-f1e9127c-64ef-41a7-b392-6c29427555bf req-b5b9a31b-e6f9-4d72-9dc6-2db1a9c05a91 service nova] Creating event network-vif-plugged:3ccfabb1-82b3-4904-a943-c29622e0b546 for instance fe7dae80-4592-45ea-a52d-05aa559c102a on hv-cinder-81398 Oct 19 08:29:01.637683 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-f1e9127c-64ef-41a7-b392-6c29427555bf req-b5b9a31b-e6f9-4d72-9dc6-2db1a9c05a91 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057415 Oct 19 08:29:01.639096 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 471/933] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:29:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:29:01.721098 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-f90313a1-42b1-45a8-b263-8ed29f16335c tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:01.722041 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-f90313a1-42b1-45a8-b263-8ed29f16335c tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] [instance: 2fa627cc-cd11-452a-bde6-f942981f8176] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:01.729702 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f90313a1-42b1-45a8-b263-8ed29f16335c tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:01.730576 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f90313a1-42b1-45a8-b263-8ed29f16335c tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:01.731728 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f90313a1-42b1-45a8-b263-8ed29f16335c tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:01.732425 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f90313a1-42b1-45a8-b263-8ed29f16335c tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:01.772132 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-1ba3e595-322f-4658-b9c9-ece613e3f747 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:01.773005 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-1ba3e595-322f-4658-b9c9-ece613e3f747 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:01.783284 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1ba3e595-322f-4658-b9c9-ece613e3f747 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:01.783852 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1ba3e595-322f-4658-b9c9-ece613e3f747 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:01.784718 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1ba3e595-322f-4658-b9c9-ece613e3f747 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:01.788355 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1ba3e595-322f-4658-b9c9-ece613e3f747 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:02.159038 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-f90313a1-42b1-45a8-b263-8ed29f16335c tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2218e5c14d72437395e0800a182f5e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c07ba81dc364646bfacfb309f6a1b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:02.174470 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-f90313a1-42b1-45a8-b263-8ed29f16335c tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176" status: 200 len: 1471 microversion: 2.1 time: 0.459157 Oct 19 08:29:02.177806 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 463/934] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:29:01 2021] GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176 => generated 1471 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:29:02.178564 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-1ba3e595-322f-4658-b9c9-ece613e3f747 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:02.183794 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-f1e19355-e0e0-4414-8362-308d6e499d21 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:02.184659 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-f1e19355-e0e0-4414-8362-308d6e499d21 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:02.189801 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-1ba3e595-322f-4658-b9c9-ece613e3f747 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:02.193502 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-1ba3e595-322f-4658-b9c9-ece613e3f747 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:02.194711 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-1ba3e595-322f-4658-b9c9-ece613e3f747 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1746 microversion: 2.20 time: 0.428653 Oct 19 08:29:02.196272 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 472/935] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:01 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1746 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:02.198509 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f1e19355-e0e0-4414-8362-308d6e499d21 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:02.199149 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f1e19355-e0e0-4414-8362-308d6e499d21 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:02.200454 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f1e19355-e0e0-4414-8362-308d6e499d21 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:02.200827 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-d9aa17aa-5c0b-4e1f-a1a0-a5779f84f7b2 req-e6d04e54-b2a8-4ecc-b768-fa14c5347176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee918319-a52e-42ad-be1f-026c3f704860", "name": "network-vif-deleted", "tag": "f15e40d0-7913-4978-b0ff-8bd4d2ded1ec"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:29:02.201806 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f1e19355-e0e0-4414-8362-308d6e499d21 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:02.202329 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:29:02.202329 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:29:02.215838 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-d9aa17aa-5c0b-4e1f-a1a0-a5779f84f7b2 req-e6d04e54-b2a8-4ecc-b768-fa14c5347176 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:02.216445 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-d9aa17aa-5c0b-4e1f-a1a0-a5779f84f7b2 req-e6d04e54-b2a8-4ecc-b768-fa14c5347176 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:02.230327 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-d9aa17aa-5c0b-4e1f-a1a0-a5779f84f7b2 req-e6d04e54-b2a8-4ecc-b768-fa14c5347176 service nova] Creating event network-vif-deleted:f15e40d0-7913-4978-b0ff-8bd4d2ded1ec for instance ee918319-a52e-42ad-be1f-026c3f704860 on hv-cinder-81398 Oct 19 08:29:02.236704 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-d9aa17aa-5c0b-4e1f-a1a0-a5779f84f7b2 req-e6d04e54-b2a8-4ecc-b768-fa14c5347176 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039304 Oct 19 08:29:02.237301 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 473/936] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:29:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:29:02.403718 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-f1e19355-e0e0-4414-8362-308d6e499d21 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:02.412374 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-f1e19355-e0e0-4414-8362-308d6e499d21 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1722 microversion: 2.1 time: 0.233024 Oct 19 08:29:02.412955 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 464/937] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:29:02 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:29:02.633279 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-39db3c79-1b9f-4641-bd7c-eaaf4b12feef tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:02.633863 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-39db3c79-1b9f-4641-bd7c-eaaf4b12feef tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: ee918319-a52e-42ad-be1f-026c3f704860] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:02.639852 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-39db3c79-1b9f-4641-bd7c-eaaf4b12feef tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:02.640290 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-39db3c79-1b9f-4641-bd7c-eaaf4b12feef tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:02.641029 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-39db3c79-1b9f-4641-bd7c-eaaf4b12feef tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:02.641449 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-39db3c79-1b9f-4641-bd7c-eaaf4b12feef tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:02.703833 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-39db3c79-1b9f-4641-bd7c-eaaf4b12feef tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:02.711706 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-39db3c79-1b9f-4641-bd7c-eaaf4b12feef tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860" status: 200 len: 1470 microversion: 2.1 time: 0.083288 Oct 19 08:29:02.712263 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 474/938] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:29:02 2021] GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860 => generated 1470 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:29:03.193180 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-bf26884e-d11f-4b39-bcd2-7f2b15f0b779 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:03.193769 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-bf26884e-d11f-4b39-bcd2-7f2b15f0b779 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] [instance: 2fa627cc-cd11-452a-bde6-f942981f8176] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:03.199725 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bf26884e-d11f-4b39-bcd2-7f2b15f0b779 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:03.200163 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bf26884e-d11f-4b39-bcd2-7f2b15f0b779 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:03.201037 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bf26884e-d11f-4b39-bcd2-7f2b15f0b779 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:03.201465 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bf26884e-d11f-4b39-bcd2-7f2b15f0b779 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:03.212583 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-5851468c-75f3-4e38-8a77-e89ca2f8bd8c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:03.213181 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-5851468c-75f3-4e38-8a77-e89ca2f8bd8c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:03.219826 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5851468c-75f3-4e38-8a77-e89ca2f8bd8c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:03.220272 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5851468c-75f3-4e38-8a77-e89ca2f8bd8c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:03.221042 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5851468c-75f3-4e38-8a77-e89ca2f8bd8c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:03.221470 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5851468c-75f3-4e38-8a77-e89ca2f8bd8c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:03.264187 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-bf26884e-d11f-4b39-bcd2-7f2b15f0b779 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2218e5c14d72437395e0800a182f5e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c07ba81dc364646bfacfb309f6a1b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:03.272031 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-bf26884e-d11f-4b39-bcd2-7f2b15f0b779 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176" status: 200 len: 1429 microversion: 2.1 time: 0.082606 Oct 19 08:29:03.272603 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 465/939] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:29:03 2021] GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176 => generated 1429 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:29:03.347529 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-5851468c-75f3-4e38-8a77-e89ca2f8bd8c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:03.355307 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-5851468c-75f3-4e38-8a77-e89ca2f8bd8c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:03.356784 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-5851468c-75f3-4e38-8a77-e89ca2f8bd8c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:03.357923 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-5851468c-75f3-4e38-8a77-e89ca2f8bd8c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1746 microversion: 2.20 time: 0.148977 Oct 19 08:29:03.358474 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 475/940] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:03 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:29:03.429066 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-3f5d180b-ca46-4421-a2cc-4bb25c034500 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:03.429669 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-3f5d180b-ca46-4421-a2cc-4bb25c034500 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:03.435487 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3f5d180b-ca46-4421-a2cc-4bb25c034500 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:03.435929 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3f5d180b-ca46-4421-a2cc-4bb25c034500 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:03.436687 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3f5d180b-ca46-4421-a2cc-4bb25c034500 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:03.437119 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3f5d180b-ca46-4421-a2cc-4bb25c034500 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:03.553918 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-3f5d180b-ca46-4421-a2cc-4bb25c034500 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:03.561460 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-3f5d180b-ca46-4421-a2cc-4bb25c034500 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1722 microversion: 2.1 time: 0.136214 Oct 19 08:29:03.562021 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 466/941] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:29:03 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1722 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:29:03.728291 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-8ea49e54-7b53-407c-a97f-b8042341a382 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:03.728912 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-8ea49e54-7b53-407c-a97f-b8042341a382 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: ee918319-a52e-42ad-be1f-026c3f704860] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:03.734622 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8ea49e54-7b53-407c-a97f-b8042341a382 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:03.735059 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8ea49e54-7b53-407c-a97f-b8042341a382 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:03.735800 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8ea49e54-7b53-407c-a97f-b8042341a382 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:03.736223 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8ea49e54-7b53-407c-a97f-b8042341a382 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:03.797491 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-8ea49e54-7b53-407c-a97f-b8042341a382 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:03.806422 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-8ea49e54-7b53-407c-a97f-b8042341a382 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860" status: 200 len: 1470 microversion: 2.1 time: 0.081749 Oct 19 08:29:03.807004 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 476/942] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:29:03 2021] GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860 => generated 1470 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:29:04.257265 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-34d07839-7967-462d-8a83-0f8c60fd7483 req-fb3305ea-0ff0-4819-957f-d4b057f0101b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fa627cc-cd11-452a-bde6-f942981f8176", "name": "network-vif-deleted", "tag": "25da375e-68a3-4aab-9d7b-2a5b7029e754"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:29:04.259092 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:29:04.259092 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:29:04.265713 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-34d07839-7967-462d-8a83-0f8c60fd7483 req-fb3305ea-0ff0-4819-957f-d4b057f0101b service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:04.266151 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-34d07839-7967-462d-8a83-0f8c60fd7483 req-fb3305ea-0ff0-4819-957f-d4b057f0101b service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:04.281099 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-34d07839-7967-462d-8a83-0f8c60fd7483 req-fb3305ea-0ff0-4819-957f-d4b057f0101b service nova] Creating event network-vif-deleted:25da375e-68a3-4aab-9d7b-2a5b7029e754 for instance 2fa627cc-cd11-452a-bde6-f942981f8176 on hv-cinder-81398 Oct 19 08:29:04.283579 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-34d07839-7967-462d-8a83-0f8c60fd7483 req-fb3305ea-0ff0-4819-957f-d4b057f0101b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030219 Oct 19 08:29:04.284152 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 467/943] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:29:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:29:04.290355 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-60715ea1-cb2b-4a57-8125-398abf1524ec tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:04.290993 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-60715ea1-cb2b-4a57-8125-398abf1524ec tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] [instance: 2fa627cc-cd11-452a-bde6-f942981f8176] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:04.296760 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-60715ea1-cb2b-4a57-8125-398abf1524ec tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:04.297209 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-60715ea1-cb2b-4a57-8125-398abf1524ec tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:04.297963 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-60715ea1-cb2b-4a57-8125-398abf1524ec tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:04.298390 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-60715ea1-cb2b-4a57-8125-398abf1524ec tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:04.356334 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-60715ea1-cb2b-4a57-8125-398abf1524ec tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2218e5c14d72437395e0800a182f5e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c07ba81dc364646bfacfb309f6a1b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:04.363480 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-60715ea1-cb2b-4a57-8125-398abf1524ec tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176" status: 200 len: 1429 microversion: 2.1 time: 0.076654 Oct 19 08:29:04.364045 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 477/944] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:29:04 2021] GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176 => generated 1429 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:29:04.376374 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8df260aa-d34e-4414-9aab-9660d6f86acd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:04.377156 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-8df260aa-d34e-4414-9aab-9660d6f86acd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:04.383655 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8df260aa-d34e-4414-9aab-9660d6f86acd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:04.384108 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8df260aa-d34e-4414-9aab-9660d6f86acd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:04.384897 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8df260aa-d34e-4414-9aab-9660d6f86acd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:04.385328 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8df260aa-d34e-4414-9aab-9660d6f86acd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:04.511951 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-8df260aa-d34e-4414-9aab-9660d6f86acd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:04.519977 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-8df260aa-d34e-4414-9aab-9660d6f86acd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:04.521473 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-8df260aa-d34e-4414-9aab-9660d6f86acd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:04.522650 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-8df260aa-d34e-4414-9aab-9660d6f86acd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1746 microversion: 2.20 time: 0.150279 Oct 19 08:29:04.523204 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 468/945] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:04 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:04.579230 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-52e6bf01-fc85-4329-9103-5a37563d2a5c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:04.579834 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-52e6bf01-fc85-4329-9103-5a37563d2a5c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:04.586228 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-52e6bf01-fc85-4329-9103-5a37563d2a5c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:04.586701 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-52e6bf01-fc85-4329-9103-5a37563d2a5c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:04.587447 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-52e6bf01-fc85-4329-9103-5a37563d2a5c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:04.587867 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-52e6bf01-fc85-4329-9103-5a37563d2a5c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:04.703799 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-52e6bf01-fc85-4329-9103-5a37563d2a5c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:04.711961 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-52e6bf01-fc85-4329-9103-5a37563d2a5c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1722 microversion: 2.1 time: 0.136353 Oct 19 08:29:04.712529 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 478/946] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:29:04 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1722 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:29:04.824108 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-1052da5b-fcf9-4500-81a5-b16d399af8f3 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:04.824710 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-1052da5b-fcf9-4500-81a5-b16d399af8f3 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: ee918319-a52e-42ad-be1f-026c3f704860] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:04.830511 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1052da5b-fcf9-4500-81a5-b16d399af8f3 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:04.830982 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1052da5b-fcf9-4500-81a5-b16d399af8f3 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:04.831744 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1052da5b-fcf9-4500-81a5-b16d399af8f3 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:04.832996 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1052da5b-fcf9-4500-81a5-b16d399af8f3 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:04.893953 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-1052da5b-fcf9-4500-81a5-b16d399af8f3 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:04.901907 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-1052da5b-fcf9-4500-81a5-b16d399af8f3 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860" status: 200 len: 1470 microversion: 2.1 time: 0.081920 Oct 19 08:29:04.902464 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 469/947] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:29:04 2021] GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860 => generated 1470 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:29:05.379497 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-6843e01f-519e-4487-963c-679cbeb9f6b2 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:05.380649 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-6843e01f-519e-4487-963c-679cbeb9f6b2 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] [instance: 2fa627cc-cd11-452a-bde6-f942981f8176] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:05.386693 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6843e01f-519e-4487-963c-679cbeb9f6b2 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:05.387137 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6843e01f-519e-4487-963c-679cbeb9f6b2 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:05.387899 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6843e01f-519e-4487-963c-679cbeb9f6b2 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:05.388321 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6843e01f-519e-4487-963c-679cbeb9f6b2 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:05.449480 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-6843e01f-519e-4487-963c-679cbeb9f6b2 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2218e5c14d72437395e0800a182f5e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c07ba81dc364646bfacfb309f6a1b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:05.456621 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-6843e01f-519e-4487-963c-679cbeb9f6b2 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176" status: 200 len: 1429 microversion: 2.1 time: 0.080935 Oct 19 08:29:05.457231 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 479/948] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:29:05 2021] GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176 => generated 1429 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:29:05.541358 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-02c30dae-fda3-4121-97ca-07664ac34b8f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:05.542047 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-02c30dae-fda3-4121-97ca-07664ac34b8f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:05.548342 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-02c30dae-fda3-4121-97ca-07664ac34b8f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:05.548881 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-02c30dae-fda3-4121-97ca-07664ac34b8f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:05.550030 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-02c30dae-fda3-4121-97ca-07664ac34b8f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:05.550753 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-02c30dae-fda3-4121-97ca-07664ac34b8f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:05.729406 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3f880051-0394-40bb-bcab-f13c5dc3631e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:05.730011 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3f880051-0394-40bb-bcab-f13c5dc3631e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:05.735769 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3f880051-0394-40bb-bcab-f13c5dc3631e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:05.736211 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3f880051-0394-40bb-bcab-f13c5dc3631e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:05.736970 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3f880051-0394-40bb-bcab-f13c5dc3631e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:05.737404 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3f880051-0394-40bb-bcab-f13c5dc3631e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:05.944317 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3f880051-0394-40bb-bcab-f13c5dc3631e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:05.952969 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3f880051-0394-40bb-bcab-f13c5dc3631e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1722 microversion: 2.1 time: 0.227172 Oct 19 08:29:05.958558 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-02c30dae-fda3-4121-97ca-07664ac34b8f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:05.958729 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 480/949] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:29:05 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:29:05.959034 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-fee899d4-6e49-43cf-aaa3-228dcddda6c0 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:05.959473 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-fee899d4-6e49-43cf-aaa3-228dcddda6c0 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: ee918319-a52e-42ad-be1f-026c3f704860] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:05.965854 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fee899d4-6e49-43cf-aaa3-228dcddda6c0 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:05.966300 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fee899d4-6e49-43cf-aaa3-228dcddda6c0 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:05.967101 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fee899d4-6e49-43cf-aaa3-228dcddda6c0 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:05.967527 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fee899d4-6e49-43cf-aaa3-228dcddda6c0 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:05.967637 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-02c30dae-fda3-4121-97ca-07664ac34b8f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:05.969149 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-02c30dae-fda3-4121-97ca-07664ac34b8f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:05.970472 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-02c30dae-fda3-4121-97ca-07664ac34b8f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1741 microversion: 2.20 time: 0.432889 Oct 19 08:29:05.972376 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 470/950] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:05 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1741 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:05.999296 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fee899d4-6e49-43cf-aaa3-228dcddda6c0 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:05.999818 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fee899d4-6e49-43cf-aaa3-228dcddda6c0 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:06.000253 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.objects.instance [None req-fee899d4-6e49-43cf-aaa3-228dcddda6c0 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lazy-loading 'fault' on Instance uuid ee918319-a52e-42ad-be1f-026c3f704860 {{(pid=114106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 19 08:29:06.043544 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-fee899d4-6e49-43cf-aaa3-228dcddda6c0 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92073952d8b34c159885daa7d0da3061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570556a465841b98162222c60bef779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:06.051066 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-fee899d4-6e49-43cf-aaa3-228dcddda6c0 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860" status: 200 len: 1308 microversion: 2.1 time: 0.096193 Oct 19 08:29:06.051849 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 481/951] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:29:05 2021] GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:29:06.475479 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8e0bacf0-d67e-476e-a905-8fb55b1229f9 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:06.476325 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-8e0bacf0-d67e-476e-a905-8fb55b1229f9 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] [instance: 2fa627cc-cd11-452a-bde6-f942981f8176] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:06.482928 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8e0bacf0-d67e-476e-a905-8fb55b1229f9 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:06.483588 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8e0bacf0-d67e-476e-a905-8fb55b1229f9 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:06.484533 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8e0bacf0-d67e-476e-a905-8fb55b1229f9 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:06.485260 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8e0bacf0-d67e-476e-a905-8fb55b1229f9 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:06.499807 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.wsgi [None req-8e0bacf0-d67e-476e-a905-8fb55b1229f9 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] HTTP exception thrown: Instance 2fa627cc-cd11-452a-bde6-f942981f8176 could not be found. Oct 19 08:29:06.500627 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8e0bacf0-d67e-476e-a905-8fb55b1229f9 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] Returning 404 to user: Instance 2fa627cc-cd11-452a-bde6-f942981f8176 could not be found. {{(pid=114105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:29:06.501646 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-8e0bacf0-d67e-476e-a905-8fb55b1229f9 tempest-VolumesNegativeTest-419634153 tempest-VolumesNegativeTest-419634153-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176" status: 404 len: 111 microversion: 2.1 time: 0.030695 Oct 19 08:29:06.502186 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 471/952] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:29:06 2021] GET /compute/v2.1/servers/2fa627cc-cd11-452a-bde6-f942981f8176 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:29:06.976158 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-77afc68a-7013-4b25-8213-a20ddd7960a6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:06.976764 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-77afc68a-7013-4b25-8213-a20ddd7960a6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:06.986106 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-77afc68a-7013-4b25-8213-a20ddd7960a6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:06.986826 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-77afc68a-7013-4b25-8213-a20ddd7960a6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:06.988780 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-77afc68a-7013-4b25-8213-a20ddd7960a6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:06.989319 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-ed5137c8-679e-42fb-a7cc-efb6a77472eb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:06.990051 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-77afc68a-7013-4b25-8213-a20ddd7960a6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:06.990214 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-ed5137c8-679e-42fb-a7cc-efb6a77472eb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:07.000002 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ed5137c8-679e-42fb-a7cc-efb6a77472eb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:07.000881 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ed5137c8-679e-42fb-a7cc-efb6a77472eb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:07.001926 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ed5137c8-679e-42fb-a7cc-efb6a77472eb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:07.005097 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ed5137c8-679e-42fb-a7cc-efb6a77472eb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:07.227018 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-ed5137c8-679e-42fb-a7cc-efb6a77472eb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:07.235860 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-ed5137c8-679e-42fb-a7cc-efb6a77472eb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:07.239084 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-ed5137c8-679e-42fb-a7cc-efb6a77472eb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:07.245903 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-ed5137c8-679e-42fb-a7cc-efb6a77472eb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1741 microversion: 2.20 time: 0.260618 Oct 19 08:29:07.252491 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 472/953] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:06 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1741 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:29:07.263692 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8ed39236-aa44-40f8-863a-ef75562bbb54 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:07.264310 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-8ed39236-aa44-40f8-863a-ef75562bbb54 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] [instance: ee918319-a52e-42ad-be1f-026c3f704860] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:07.272152 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8ed39236-aa44-40f8-863a-ef75562bbb54 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:07.272604 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8ed39236-aa44-40f8-863a-ef75562bbb54 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:07.273383 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8ed39236-aa44-40f8-863a-ef75562bbb54 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:07.273818 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8ed39236-aa44-40f8-863a-ef75562bbb54 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:07.309469 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.wsgi [None req-8ed39236-aa44-40f8-863a-ef75562bbb54 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] HTTP exception thrown: Instance ee918319-a52e-42ad-be1f-026c3f704860 could not be found. Oct 19 08:29:07.310886 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8ed39236-aa44-40f8-863a-ef75562bbb54 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] Returning 404 to user: Instance ee918319-a52e-42ad-be1f-026c3f704860 could not be found. {{(pid=114105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:29:07.315217 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-8ed39236-aa44-40f8-863a-ef75562bbb54 tempest-VolumesSnapshotTestJSON-1589660903 tempest-VolumesSnapshotTestJSON-1589660903-project] 10.222.0.26 "GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860" status: 404 len: 111 microversion: 2.1 time: 0.061502 Oct 19 08:29:07.326544 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 473/954] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:29:07 2021] GET /compute/v2.1/servers/ee918319-a52e-42ad-be1f-026c3f704860 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:29:07.390156 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-77afc68a-7013-4b25-8213-a20ddd7960a6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:07.404241 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-77afc68a-7013-4b25-8213-a20ddd7960a6 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1722 microversion: 2.1 time: 0.432750 Oct 19 08:29:07.405057 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 482/955] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:29:06 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1722 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:29:08.265487 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-0e20e068-7df6-42c6-9258-5b9ca705cc94 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:08.266000 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-0e20e068-7df6-42c6-9258-5b9ca705cc94 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:08.274596 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0e20e068-7df6-42c6-9258-5b9ca705cc94 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:08.281524 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0e20e068-7df6-42c6-9258-5b9ca705cc94 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:08.282448 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0e20e068-7df6-42c6-9258-5b9ca705cc94 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:08.282983 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0e20e068-7df6-42c6-9258-5b9ca705cc94 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:08.427134 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-d54829a2-5f84-4706-875b-6b1fb0777ae9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:08.428263 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-d54829a2-5f84-4706-875b-6b1fb0777ae9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:08.438438 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d54829a2-5f84-4706-875b-6b1fb0777ae9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:08.440565 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d54829a2-5f84-4706-875b-6b1fb0777ae9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:08.441866 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d54829a2-5f84-4706-875b-6b1fb0777ae9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:08.442761 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d54829a2-5f84-4706-875b-6b1fb0777ae9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:08.498680 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-0e20e068-7df6-42c6-9258-5b9ca705cc94 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:08.509553 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-0e20e068-7df6-42c6-9258-5b9ca705cc94 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:08.509676 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-0e20e068-7df6-42c6-9258-5b9ca705cc94 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:08.510870 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-0e20e068-7df6-42c6-9258-5b9ca705cc94 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1741 microversion: 2.20 time: 0.249969 Oct 19 08:29:08.511595 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 474/956] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:08 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1741 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:08.606210 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-d54829a2-5f84-4706-875b-6b1fb0777ae9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:08.614834 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-d54829a2-5f84-4706-875b-6b1fb0777ae9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1699 microversion: 2.1 time: 0.191566 Oct 19 08:29:08.615402 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 483/957] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:29:08 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1699 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:29:08.633284 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-3987acf3-0766-4485-bce2-6e8a1daba1f4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:29:08.639469 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3987acf3-0766-4485-bce2-6e8a1daba1f4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:08.640097 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3987acf3-0766-4485-bce2-6e8a1daba1f4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:08.709752 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-3987acf3-0766-4485-bce2-6e8a1daba1f4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Going to try to start instance {{(pid=114105) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 19 08:29:08.804787 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-3987acf3-0766-4485-bce2-6e8a1daba1f4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 202 len: 0 microversion: 2.1 time: 0.176578 Oct 19 08:29:08.807498 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 475/958] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:29:08 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:29:08.817427 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-cc0b8220-46f3-407e-a30a-a79bd36477d9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:08.818555 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-cc0b8220-46f3-407e-a30a-a79bd36477d9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:08.828844 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cc0b8220-46f3-407e-a30a-a79bd36477d9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:08.831465 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cc0b8220-46f3-407e-a30a-a79bd36477d9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:08.846882 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cc0b8220-46f3-407e-a30a-a79bd36477d9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:08.848320 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cc0b8220-46f3-407e-a30a-a79bd36477d9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:09.061975 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-cc0b8220-46f3-407e-a30a-a79bd36477d9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:09.074420 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-cc0b8220-46f3-407e-a30a-a79bd36477d9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1708 microversion: 2.1 time: 0.261680 Oct 19 08:29:09.075355 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 484/959] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:29:08 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1708 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:29:09.530378 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-5f84459f-505a-4f9a-b69a-6df275b0831c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:09.531248 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-5f84459f-505a-4f9a-b69a-6df275b0831c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:09.540279 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5f84459f-505a-4f9a-b69a-6df275b0831c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:09.541209 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5f84459f-505a-4f9a-b69a-6df275b0831c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:09.542165 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5f84459f-505a-4f9a-b69a-6df275b0831c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:09.542783 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5f84459f-505a-4f9a-b69a-6df275b0831c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:09.719768 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-5f84459f-505a-4f9a-b69a-6df275b0831c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:09.733784 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-5f84459f-505a-4f9a-b69a-6df275b0831c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:09.735558 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-5f84459f-505a-4f9a-b69a-6df275b0831c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:09.736690 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-5f84459f-505a-4f9a-b69a-6df275b0831c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1741 microversion: 2.20 time: 0.210750 Oct 19 08:29:09.737399 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 476/960] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:09 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1741 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:09.819470 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 08:29:09.819687 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: Tue Oct 19 08:29:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 19 08:29:10.093280 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-47be06cb-bf55-4ebe-a56a-320be0c45e24 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:10.093869 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-47be06cb-bf55-4ebe-a56a-320be0c45e24 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:10.100070 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-47be06cb-bf55-4ebe-a56a-320be0c45e24 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:10.100756 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-47be06cb-bf55-4ebe-a56a-320be0c45e24 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:10.102510 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-47be06cb-bf55-4ebe-a56a-320be0c45e24 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:10.103138 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-47be06cb-bf55-4ebe-a56a-320be0c45e24 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:10.266223 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-47be06cb-bf55-4ebe-a56a-320be0c45e24 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:10.276061 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-47be06cb-bf55-4ebe-a56a-320be0c45e24 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1708 microversion: 2.1 time: 0.187056 Oct 19 08:29:10.282013 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 485/961] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:29:10 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1708 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:29:10.755886 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-e4078951-0f49-40b3-8873-9cb46aed58b6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:10.757178 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-e4078951-0f49-40b3-8873-9cb46aed58b6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:10.764396 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e4078951-0f49-40b3-8873-9cb46aed58b6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:10.765136 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e4078951-0f49-40b3-8873-9cb46aed58b6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:10.766064 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e4078951-0f49-40b3-8873-9cb46aed58b6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:10.766680 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e4078951-0f49-40b3-8873-9cb46aed58b6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:10.913798 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-e4078951-0f49-40b3-8873-9cb46aed58b6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:10.921867 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-e4078951-0f49-40b3-8873-9cb46aed58b6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:10.923506 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-e4078951-0f49-40b3-8873-9cb46aed58b6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:10.924793 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-e4078951-0f49-40b3-8873-9cb46aed58b6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1741 microversion: 2.20 time: 0.173081 Oct 19 08:29:10.925340 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 477/962] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:10 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1741 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:11.294302 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-7d4fe724-a61f-4d77-acda-e99933de6ad2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:11.294957 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-7d4fe724-a61f-4d77-acda-e99933de6ad2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:11.305588 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7d4fe724-a61f-4d77-acda-e99933de6ad2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:11.306162 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7d4fe724-a61f-4d77-acda-e99933de6ad2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:11.307336 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7d4fe724-a61f-4d77-acda-e99933de6ad2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:11.307834 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7d4fe724-a61f-4d77-acda-e99933de6ad2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:11.453930 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-7d4fe724-a61f-4d77-acda-e99933de6ad2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:11.470994 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-7d4fe724-a61f-4d77-acda-e99933de6ad2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1708 microversion: 2.1 time: 0.180126 Oct 19 08:29:11.471871 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 486/963] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:29:11 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1708 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:29:11.943933 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-df002f46-71f8-4755-b68d-921b4e260a5e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:11.944532 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-df002f46-71f8-4755-b68d-921b4e260a5e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:11.951023 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-df002f46-71f8-4755-b68d-921b4e260a5e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:11.951749 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-df002f46-71f8-4755-b68d-921b4e260a5e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:11.952590 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-df002f46-71f8-4755-b68d-921b4e260a5e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:11.953090 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-df002f46-71f8-4755-b68d-921b4e260a5e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:12.130417 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-df002f46-71f8-4755-b68d-921b4e260a5e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:12.139716 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-df002f46-71f8-4755-b68d-921b4e260a5e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:12.141897 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-df002f46-71f8-4755-b68d-921b4e260a5e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:12.143433 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-df002f46-71f8-4755-b68d-921b4e260a5e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1741 microversion: 2.20 time: 0.203884 Oct 19 08:29:12.144131 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 478/964] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:11 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1741 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:12.505920 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-1ab7a741-70c5-4887-a762-7a97ef6c5c5e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:12.507334 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-1ab7a741-70c5-4887-a762-7a97ef6c5c5e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:12.520603 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1ab7a741-70c5-4887-a762-7a97ef6c5c5e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:12.521340 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1ab7a741-70c5-4887-a762-7a97ef6c5c5e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:12.522714 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1ab7a741-70c5-4887-a762-7a97ef6c5c5e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:12.523302 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1ab7a741-70c5-4887-a762-7a97ef6c5c5e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:12.795802 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-1ab7a741-70c5-4887-a762-7a97ef6c5c5e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:12.804037 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-1ab7a741-70c5-4887-a762-7a97ef6c5c5e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1708 microversion: 2.1 time: 0.303009 Oct 19 08:29:12.804707 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 487/965] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:29:12 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1708 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:29:13.161727 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-1a6a7031-d8c0-46d1-b7ed-31bece93a8fe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:13.162363 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-1a6a7031-d8c0-46d1-b7ed-31bece93a8fe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:13.168479 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1a6a7031-d8c0-46d1-b7ed-31bece93a8fe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:13.169177 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1a6a7031-d8c0-46d1-b7ed-31bece93a8fe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:13.170182 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1a6a7031-d8c0-46d1-b7ed-31bece93a8fe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:13.170797 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1a6a7031-d8c0-46d1-b7ed-31bece93a8fe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:13.328378 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-1a6a7031-d8c0-46d1-b7ed-31bece93a8fe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:13.338127 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-1a6a7031-d8c0-46d1-b7ed-31bece93a8fe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:13.339857 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-1a6a7031-d8c0-46d1-b7ed-31bece93a8fe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:13.342168 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-1a6a7031-d8c0-46d1-b7ed-31bece93a8fe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1741 microversion: 2.20 time: 0.184600 Oct 19 08:29:13.351806 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 479/966] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:13 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1741 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:13.823175 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-298dcbb0-6dbd-4180-a54c-0db1d60b4096 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:13.823975 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-298dcbb0-6dbd-4180-a54c-0db1d60b4096 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:13.831434 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-298dcbb0-6dbd-4180-a54c-0db1d60b4096 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:13.832182 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-298dcbb0-6dbd-4180-a54c-0db1d60b4096 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:13.833291 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-298dcbb0-6dbd-4180-a54c-0db1d60b4096 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:13.834476 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-298dcbb0-6dbd-4180-a54c-0db1d60b4096 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:13.965262 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-298dcbb0-6dbd-4180-a54c-0db1d60b4096 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:13.977787 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-298dcbb0-6dbd-4180-a54c-0db1d60b4096 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1708 microversion: 2.1 time: 0.159099 Oct 19 08:29:13.987871 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 488/967] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:29:13 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1708 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:29:14.361679 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-408d3ea4-d651-452e-8388-5c7c2f4f40a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:14.362989 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-408d3ea4-d651-452e-8388-5c7c2f4f40a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:14.369429 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-408d3ea4-d651-452e-8388-5c7c2f4f40a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:14.369873 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-408d3ea4-d651-452e-8388-5c7c2f4f40a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:14.370675 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-408d3ea4-d651-452e-8388-5c7c2f4f40a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:14.371105 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-408d3ea4-d651-452e-8388-5c7c2f4f40a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:14.520128 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-408d3ea4-d651-452e-8388-5c7c2f4f40a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:14.528639 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-408d3ea4-d651-452e-8388-5c7c2f4f40a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:14.530281 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-408d3ea4-d651-452e-8388-5c7c2f4f40a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:14.531710 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-408d3ea4-d651-452e-8388-5c7c2f4f40a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1741 microversion: 2.20 time: 0.173724 Oct 19 08:29:14.532628 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 480/968] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:14 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1741 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:14.994567 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3067a8c0-24aa-4b8f-a442-ab2050e26dd3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:14.995161 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3067a8c0-24aa-4b8f-a442-ab2050e26dd3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:15.001421 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3067a8c0-24aa-4b8f-a442-ab2050e26dd3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:15.002048 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3067a8c0-24aa-4b8f-a442-ab2050e26dd3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:15.003166 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3067a8c0-24aa-4b8f-a442-ab2050e26dd3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:15.003613 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3067a8c0-24aa-4b8f-a442-ab2050e26dd3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:15.157894 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3067a8c0-24aa-4b8f-a442-ab2050e26dd3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:15.167289 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3067a8c0-24aa-4b8f-a442-ab2050e26dd3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1708 microversion: 2.1 time: 0.176315 Oct 19 08:29:15.168405 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 489/969] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:29:14 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1708 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:29:15.665320 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-bd32a072-bebb-4605-8c49-7aaf57305a55 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:15.666117 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-bd32a072-bebb-4605-8c49-7aaf57305a55 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:15.672580 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bd32a072-bebb-4605-8c49-7aaf57305a55 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:15.673026 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bd32a072-bebb-4605-8c49-7aaf57305a55 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:15.674522 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bd32a072-bebb-4605-8c49-7aaf57305a55 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:15.675325 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bd32a072-bebb-4605-8c49-7aaf57305a55 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:15.821429 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-bd32a072-bebb-4605-8c49-7aaf57305a55 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:15.844075 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-bd32a072-bebb-4605-8c49-7aaf57305a55 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:15.845627 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-bd32a072-bebb-4605-8c49-7aaf57305a55 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:15.846897 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-bd32a072-bebb-4605-8c49-7aaf57305a55 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1741 microversion: 2.20 time: 0.299930 Oct 19 08:29:15.848361 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 481/970] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:15 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1741 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:16.185605 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e00dd968-5029-4825-bf6c-3f9a814fcaac tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:16.186325 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e00dd968-5029-4825-bf6c-3f9a814fcaac tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:16.193072 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e00dd968-5029-4825-bf6c-3f9a814fcaac tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:16.193931 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e00dd968-5029-4825-bf6c-3f9a814fcaac tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:16.195126 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e00dd968-5029-4825-bf6c-3f9a814fcaac tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:16.195877 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e00dd968-5029-4825-bf6c-3f9a814fcaac tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:16.325651 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-e00dd968-5029-4825-bf6c-3f9a814fcaac tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:16.334530 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e00dd968-5029-4825-bf6c-3f9a814fcaac tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1708 microversion: 2.1 time: 0.152661 Oct 19 08:29:16.335272 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 490/971] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:29:16 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1708 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:29:16.867669 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-dcafca33-5ab4-4c2f-a238-75dd17a31006 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:16.868271 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-dcafca33-5ab4-4c2f-a238-75dd17a31006 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:16.874152 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dcafca33-5ab4-4c2f-a238-75dd17a31006 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:16.874638 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dcafca33-5ab4-4c2f-a238-75dd17a31006 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:16.875397 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dcafca33-5ab4-4c2f-a238-75dd17a31006 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:16.875825 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dcafca33-5ab4-4c2f-a238-75dd17a31006 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:17.004449 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-dcafca33-5ab4-4c2f-a238-75dd17a31006 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:17.013461 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-dcafca33-5ab4-4c2f-a238-75dd17a31006 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:17.014993 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-dcafca33-5ab4-4c2f-a238-75dd17a31006 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:17.016143 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-dcafca33-5ab4-4c2f-a238-75dd17a31006 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1741 microversion: 2.20 time: 0.152895 Oct 19 08:29:17.016710 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 482/972] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:16 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1741 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:17.350791 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b4d50b26-de66-4d57-9804-f291a7cb61bd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:17.351516 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b4d50b26-de66-4d57-9804-f291a7cb61bd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:17.357346 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b4d50b26-de66-4d57-9804-f291a7cb61bd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:17.357787 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b4d50b26-de66-4d57-9804-f291a7cb61bd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:17.358577 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b4d50b26-de66-4d57-9804-f291a7cb61bd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:17.359007 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b4d50b26-de66-4d57-9804-f291a7cb61bd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:17.486400 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-b4d50b26-de66-4d57-9804-f291a7cb61bd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:17.494482 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b4d50b26-de66-4d57-9804-f291a7cb61bd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1712 microversion: 2.1 time: 0.147315 Oct 19 08:29:17.495257 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 491/973] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:29:17 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1712 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:29:18.035082 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-9c5cf362-cdd4-438c-b460-39fd93007903 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:18.035682 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-9c5cf362-cdd4-438c-b460-39fd93007903 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:18.043878 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9c5cf362-cdd4-438c-b460-39fd93007903 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:18.044337 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9c5cf362-cdd4-438c-b460-39fd93007903 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:18.045338 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9c5cf362-cdd4-438c-b460-39fd93007903 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:18.045906 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9c5cf362-cdd4-438c-b460-39fd93007903 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:18.322235 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-9c5cf362-cdd4-438c-b460-39fd93007903 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:18.330570 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-9c5cf362-cdd4-438c-b460-39fd93007903 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:18.332232 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-9c5cf362-cdd4-438c-b460-39fd93007903 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:18.333554 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-9c5cf362-cdd4-438c-b460-39fd93007903 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1723 microversion: 2.20 time: 0.302207 Oct 19 08:29:18.334837 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 483/974] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:18 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1723 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:19.352211 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-293fbb4a-b868-4d5e-80ec-8eb09e770a44 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:19.352862 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-293fbb4a-b868-4d5e-80ec-8eb09e770a44 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:19.358503 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-293fbb4a-b868-4d5e-80ec-8eb09e770a44 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:19.359062 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-293fbb4a-b868-4d5e-80ec-8eb09e770a44 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:19.359822 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-293fbb4a-b868-4d5e-80ec-8eb09e770a44 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:19.360247 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-293fbb4a-b868-4d5e-80ec-8eb09e770a44 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:19.489171 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-293fbb4a-b868-4d5e-80ec-8eb09e770a44 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:19.498281 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-293fbb4a-b868-4d5e-80ec-8eb09e770a44 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:19.499806 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-293fbb4a-b868-4d5e-80ec-8eb09e770a44 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:19.501366 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-293fbb4a-b868-4d5e-80ec-8eb09e770a44 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1723 microversion: 2.20 time: 0.152572 Oct 19 08:29:19.502125 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 492/975] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:19 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:20.520323 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-cfdf8c8d-29f4-4f36-bb27-5e6cc6418f93 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:20.521340 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-cfdf8c8d-29f4-4f36-bb27-5e6cc6418f93 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:20.527220 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cfdf8c8d-29f4-4f36-bb27-5e6cc6418f93 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:20.527877 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cfdf8c8d-29f4-4f36-bb27-5e6cc6418f93 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:20.528642 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cfdf8c8d-29f4-4f36-bb27-5e6cc6418f93 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:20.529077 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cfdf8c8d-29f4-4f36-bb27-5e6cc6418f93 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:20.654836 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-cfdf8c8d-29f4-4f36-bb27-5e6cc6418f93 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:20.665370 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-cfdf8c8d-29f4-4f36-bb27-5e6cc6418f93 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:20.667269 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-cfdf8c8d-29f4-4f36-bb27-5e6cc6418f93 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:20.668803 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-cfdf8c8d-29f4-4f36-bb27-5e6cc6418f93 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1726 microversion: 2.20 time: 0.152061 Oct 19 08:29:20.669589 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 484/976] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:20 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:20.687559 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-5834fe59-6b8b-49f7-8a6c-4303373d54c0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be9ee660-628b-4cbf-82a4-76d19c5358be"}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:29:20.689230 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-5834fe59-6b8b-49f7-8a6c-4303373d54c0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:20.695618 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5834fe59-6b8b-49f7-8a6c-4303373d54c0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:20.695917 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5834fe59-6b8b-49f7-8a6c-4303373d54c0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:20.697037 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5834fe59-6b8b-49f7-8a6c-4303373d54c0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:20.697230 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5834fe59-6b8b-49f7-8a6c-4303373d54c0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:20.987651 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-5834fe59-6b8b-49f7-8a6c-4303373d54c0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.304173 Oct 19 08:29:20.988347 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 493/977] 10.222.0.26 () {62 vars in 1363 bytes} [Tue Oct 19 08:29:20 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/os-volume_attachments => generated 188 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:29:21.097169 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2cf02c1f-5f78-41eb-ae53-0291e8e6f5e3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:29:21.097739 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2cf02c1f-5f78-41eb-ae53-0291e8e6f5e3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:21.104108 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2cf02c1f-5f78-41eb-ae53-0291e8e6f5e3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:21.104557 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2cf02c1f-5f78-41eb-ae53-0291e8e6f5e3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:21.105324 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2cf02c1f-5f78-41eb-ae53-0291e8e6f5e3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:21.105764 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2cf02c1f-5f78-41eb-ae53-0291e8e6f5e3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:21.325843 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2cf02c1f-5f78-41eb-ae53-0291e8e6f5e3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action" status: 202 len: 0 microversion: 2.20 time: 0.232363 Oct 19 08:29:21.326984 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 485/978] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:29:21 2021] POST /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 19 08:29:21.336258 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-277dfe7c-1e0d-49af-ab27-a5d0656c4b20 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:21.337147 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-277dfe7c-1e0d-49af-ab27-a5d0656c4b20 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:21.348508 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-277dfe7c-1e0d-49af-ab27-a5d0656c4b20 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:21.349025 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-277dfe7c-1e0d-49af-ab27-a5d0656c4b20 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:21.349910 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-277dfe7c-1e0d-49af-ab27-a5d0656c4b20 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:21.350349 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-277dfe7c-1e0d-49af-ab27-a5d0656c4b20 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:21.531063 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-277dfe7c-1e0d-49af-ab27-a5d0656c4b20 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:21.545907 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-277dfe7c-1e0d-49af-ab27-a5d0656c4b20 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:21.547910 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-277dfe7c-1e0d-49af-ab27-a5d0656c4b20 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:21.549447 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-277dfe7c-1e0d-49af-ab27-a5d0656c4b20 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1752 microversion: 2.20 time: 0.218313 Oct 19 08:29:21.551244 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 494/979] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:21 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1752 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:22.569685 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-239cd5b1-c87c-4aa4-8d83-9c5c1af40ee2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:22.570288 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-239cd5b1-c87c-4aa4-8d83-9c5c1af40ee2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:22.576197 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-239cd5b1-c87c-4aa4-8d83-9c5c1af40ee2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:22.576642 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-239cd5b1-c87c-4aa4-8d83-9c5c1af40ee2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:22.577407 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-239cd5b1-c87c-4aa4-8d83-9c5c1af40ee2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:22.577836 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-239cd5b1-c87c-4aa4-8d83-9c5c1af40ee2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:22.700041 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-239cd5b1-c87c-4aa4-8d83-9c5c1af40ee2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:22.708737 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-239cd5b1-c87c-4aa4-8d83-9c5c1af40ee2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:22.710518 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-239cd5b1-c87c-4aa4-8d83-9c5c1af40ee2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:22.711668 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-239cd5b1-c87c-4aa4-8d83-9c5c1af40ee2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1752 microversion: 2.20 time: 0.146439 Oct 19 08:29:22.712215 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 486/980] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:22 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1752 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:23.729813 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3aa4a83c-964d-41ac-b826-73b79eddecfe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:23.730407 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3aa4a83c-964d-41ac-b826-73b79eddecfe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:23.736159 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3aa4a83c-964d-41ac-b826-73b79eddecfe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:23.736606 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3aa4a83c-964d-41ac-b826-73b79eddecfe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:23.737352 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3aa4a83c-964d-41ac-b826-73b79eddecfe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:23.737772 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3aa4a83c-964d-41ac-b826-73b79eddecfe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:23.858887 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3aa4a83c-964d-41ac-b826-73b79eddecfe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:23.867457 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3aa4a83c-964d-41ac-b826-73b79eddecfe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:23.868946 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3aa4a83c-964d-41ac-b826-73b79eddecfe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:23.870079 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3aa4a83c-964d-41ac-b826-73b79eddecfe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1752 microversion: 2.20 time: 0.143955 Oct 19 08:29:23.870687 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 495/981] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:23 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1752 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:24.862641 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-87342d2d-8300-4282-a2d9-9177b5588c34 req-2ba474a8-1992-458b-8ce6-e35f108c9af2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7dae80-4592-45ea-a52d-05aa559c102a", "name": "network-vif-unplugged", "status": "completed", "tag": "3ccfabb1-82b3-4904-a943-c29622e0b546"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:29:24.864286 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:29:24.864286 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:29:24.871355 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-87342d2d-8300-4282-a2d9-9177b5588c34 req-2ba474a8-1992-458b-8ce6-e35f108c9af2 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:24.871783 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-87342d2d-8300-4282-a2d9-9177b5588c34 req-2ba474a8-1992-458b-8ce6-e35f108c9af2 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:24.883413 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.compute.server_external_events [req-87342d2d-8300-4282-a2d9-9177b5588c34 req-2ba474a8-1992-458b-8ce6-e35f108c9af2 service nova] Unable to find a host for instance fe7dae80-4592-45ea-a52d-05aa559c102a. Dropping event network-vif-unplugged {{(pid=114105) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Oct 19 08:29:24.884270 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-87342d2d-8300-4282-a2d9-9177b5588c34 req-2ba474a8-1992-458b-8ce6-e35f108c9af2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025520 Oct 19 08:29:24.885065 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 487/982] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:29:24 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 19 08:29:24.887783 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-9df125a9-25c9-4c0c-a982-72c0fe582a82 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:24.888383 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-9df125a9-25c9-4c0c-a982-72c0fe582a82 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:24.894181 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9df125a9-25c9-4c0c-a982-72c0fe582a82 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:24.894659 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9df125a9-25c9-4c0c-a982-72c0fe582a82 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:24.895412 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9df125a9-25c9-4c0c-a982-72c0fe582a82 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:24.896603 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9df125a9-25c9-4c0c-a982-72c0fe582a82 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:25.023967 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-9df125a9-25c9-4c0c-a982-72c0fe582a82 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:25.032353 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-9df125a9-25c9-4c0c-a982-72c0fe582a82 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:25.033851 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-9df125a9-25c9-4c0c-a982-72c0fe582a82 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:25.035041 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-9df125a9-25c9-4c0c-a982-72c0fe582a82 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1754 microversion: 2.20 time: 0.150957 Oct 19 08:29:25.035590 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 496/983] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:24 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1754 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:29:26.054158 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-48cd5679-4b0e-4de5-a0ef-0a976b70c26b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:26.054720 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-48cd5679-4b0e-4de5-a0ef-0a976b70c26b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:26.060381 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-48cd5679-4b0e-4de5-a0ef-0a976b70c26b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:26.060821 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-48cd5679-4b0e-4de5-a0ef-0a976b70c26b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:26.061584 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-48cd5679-4b0e-4de5-a0ef-0a976b70c26b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:26.061999 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-48cd5679-4b0e-4de5-a0ef-0a976b70c26b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:26.179466 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-48cd5679-4b0e-4de5-a0ef-0a976b70c26b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:26.187609 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-48cd5679-4b0e-4de5-a0ef-0a976b70c26b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:26.189087 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-48cd5679-4b0e-4de5-a0ef-0a976b70c26b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:26.190233 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-48cd5679-4b0e-4de5-a0ef-0a976b70c26b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1754 microversion: 2.20 time: 0.140486 Oct 19 08:29:26.190819 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 488/984] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:26 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1754 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:27.207833 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-41dafc1c-2587-4723-8200-66c04755df34 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:27.209212 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-41dafc1c-2587-4723-8200-66c04755df34 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:27.214468 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-41dafc1c-2587-4723-8200-66c04755df34 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:27.214935 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-41dafc1c-2587-4723-8200-66c04755df34 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:27.215683 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-41dafc1c-2587-4723-8200-66c04755df34 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:27.216101 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-41dafc1c-2587-4723-8200-66c04755df34 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:27.337650 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-41dafc1c-2587-4723-8200-66c04755df34 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:27.345670 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-41dafc1c-2587-4723-8200-66c04755df34 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:27.347213 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-41dafc1c-2587-4723-8200-66c04755df34 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:27.348337 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-41dafc1c-2587-4723-8200-66c04755df34 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1754 microversion: 2.20 time: 0.144364 Oct 19 08:29:27.349637 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 497/985] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:27 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1754 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:28.366822 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2fdd332e-d333-4045-b96d-9024e276b61b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:28.367418 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2fdd332e-d333-4045-b96d-9024e276b61b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:28.373434 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2fdd332e-d333-4045-b96d-9024e276b61b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:28.374114 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2fdd332e-d333-4045-b96d-9024e276b61b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:28.375084 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2fdd332e-d333-4045-b96d-9024e276b61b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:28.375632 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2fdd332e-d333-4045-b96d-9024e276b61b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:28.500206 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-2fdd332e-d333-4045-b96d-9024e276b61b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:28.510664 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-2fdd332e-d333-4045-b96d-9024e276b61b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:28.512298 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-2fdd332e-d333-4045-b96d-9024e276b61b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:28.513648 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2fdd332e-d333-4045-b96d-9024e276b61b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.150485 Oct 19 08:29:28.524991 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 489/986] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:28 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:29.532969 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ad925bf5-11ec-49b5-ba90-fdd864c9790e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:29.533569 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ad925bf5-11ec-49b5-ba90-fdd864c9790e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:29.541958 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ad925bf5-11ec-49b5-ba90-fdd864c9790e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:29.542412 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ad925bf5-11ec-49b5-ba90-fdd864c9790e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:29.543381 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ad925bf5-11ec-49b5-ba90-fdd864c9790e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:29.543813 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ad925bf5-11ec-49b5-ba90-fdd864c9790e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:29.671666 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ad925bf5-11ec-49b5-ba90-fdd864c9790e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:29.682851 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ad925bf5-11ec-49b5-ba90-fdd864c9790e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:29.685038 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ad925bf5-11ec-49b5-ba90-fdd864c9790e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:29.686759 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ad925bf5-11ec-49b5-ba90-fdd864c9790e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.157964 Oct 19 08:29:29.699283 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 498/987] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:29 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:30.706063 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2a4df3a9-a9cd-4d54-a886-2f4cca844e15 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:30.706618 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2a4df3a9-a9cd-4d54-a886-2f4cca844e15 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:30.712552 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2a4df3a9-a9cd-4d54-a886-2f4cca844e15 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:30.712992 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2a4df3a9-a9cd-4d54-a886-2f4cca844e15 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:30.713748 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2a4df3a9-a9cd-4d54-a886-2f4cca844e15 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:30.714178 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2a4df3a9-a9cd-4d54-a886-2f4cca844e15 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:30.838480 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-2a4df3a9-a9cd-4d54-a886-2f4cca844e15 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:30.848350 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-2a4df3a9-a9cd-4d54-a886-2f4cca844e15 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:30.850700 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-2a4df3a9-a9cd-4d54-a886-2f4cca844e15 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:30.851957 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2a4df3a9-a9cd-4d54-a886-2f4cca844e15 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.149655 Oct 19 08:29:30.853028 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 490/988] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:30 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:31.871309 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-efa09aa6-9e01-48ec-bf38-a8da69a342ae tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:31.873067 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-efa09aa6-9e01-48ec-bf38-a8da69a342ae tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:31.880397 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-efa09aa6-9e01-48ec-bf38-a8da69a342ae tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:31.881441 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-efa09aa6-9e01-48ec-bf38-a8da69a342ae tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:31.882241 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-efa09aa6-9e01-48ec-bf38-a8da69a342ae tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:31.882712 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-efa09aa6-9e01-48ec-bf38-a8da69a342ae tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:32.015319 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-efa09aa6-9e01-48ec-bf38-a8da69a342ae tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:32.024949 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-efa09aa6-9e01-48ec-bf38-a8da69a342ae tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:32.026574 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-efa09aa6-9e01-48ec-bf38-a8da69a342ae tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:32.028067 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-efa09aa6-9e01-48ec-bf38-a8da69a342ae tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.161230 Oct 19 08:29:32.040341 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 499/989] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:31 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:33.047329 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-9eb8729d-e6ea-440e-8463-d1b7ae60cf7a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:33.048086 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-9eb8729d-e6ea-440e-8463-d1b7ae60cf7a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:33.055209 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9eb8729d-e6ea-440e-8463-d1b7ae60cf7a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:33.055731 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9eb8729d-e6ea-440e-8463-d1b7ae60cf7a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:33.056559 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9eb8729d-e6ea-440e-8463-d1b7ae60cf7a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:33.057071 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9eb8729d-e6ea-440e-8463-d1b7ae60cf7a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:33.198299 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-9eb8729d-e6ea-440e-8463-d1b7ae60cf7a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:33.206907 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-9eb8729d-e6ea-440e-8463-d1b7ae60cf7a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:33.208447 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-9eb8729d-e6ea-440e-8463-d1b7ae60cf7a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:33.210996 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-9eb8729d-e6ea-440e-8463-d1b7ae60cf7a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.167296 Oct 19 08:29:33.212086 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 491/990] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:33 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:34.229361 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-8b667685-16ad-4748-9d7d-98ef7ba0566c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:34.230033 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-8b667685-16ad-4748-9d7d-98ef7ba0566c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:34.235985 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8b667685-16ad-4748-9d7d-98ef7ba0566c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:34.236494 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8b667685-16ad-4748-9d7d-98ef7ba0566c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:34.237312 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8b667685-16ad-4748-9d7d-98ef7ba0566c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:34.237804 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8b667685-16ad-4748-9d7d-98ef7ba0566c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:34.397954 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-8b667685-16ad-4748-9d7d-98ef7ba0566c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:34.408573 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-8b667685-16ad-4748-9d7d-98ef7ba0566c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:34.410778 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-8b667685-16ad-4748-9d7d-98ef7ba0566c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:34.412310 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-8b667685-16ad-4748-9d7d-98ef7ba0566c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.186830 Oct 19 08:29:34.414246 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 500/991] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:34 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:35.436338 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-bf339313-a95c-43dc-8963-32e2b5185596 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:35.436937 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-bf339313-a95c-43dc-8963-32e2b5185596 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:35.442789 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bf339313-a95c-43dc-8963-32e2b5185596 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:35.443992 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bf339313-a95c-43dc-8963-32e2b5185596 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:35.444988 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bf339313-a95c-43dc-8963-32e2b5185596 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:35.445429 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bf339313-a95c-43dc-8963-32e2b5185596 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:35.887585 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-bf339313-a95c-43dc-8963-32e2b5185596 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:35.895800 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-bf339313-a95c-43dc-8963-32e2b5185596 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:35.897389 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-bf339313-a95c-43dc-8963-32e2b5185596 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:35.898573 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-bf339313-a95c-43dc-8963-32e2b5185596 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.466068 Oct 19 08:29:35.899130 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 492/992] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:35 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:36.917645 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-1fd1444c-d835-41d6-a096-63d0c4b93288 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:36.918321 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-1fd1444c-d835-41d6-a096-63d0c4b93288 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:36.923945 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1fd1444c-d835-41d6-a096-63d0c4b93288 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:36.924388 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1fd1444c-d835-41d6-a096-63d0c4b93288 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:36.925142 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1fd1444c-d835-41d6-a096-63d0c4b93288 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:36.925566 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1fd1444c-d835-41d6-a096-63d0c4b93288 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:37.050392 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-1fd1444c-d835-41d6-a096-63d0c4b93288 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:37.058683 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-1fd1444c-d835-41d6-a096-63d0c4b93288 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:37.060180 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-1fd1444c-d835-41d6-a096-63d0c4b93288 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:37.061328 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-1fd1444c-d835-41d6-a096-63d0c4b93288 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.147377 Oct 19 08:29:37.062075 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 501/993] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:36 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:38.080583 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-e31c4900-5cae-4e26-b2fb-bc4760c5c442 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:38.081299 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-e31c4900-5cae-4e26-b2fb-bc4760c5c442 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:38.089031 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e31c4900-5cae-4e26-b2fb-bc4760c5c442 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:38.089472 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e31c4900-5cae-4e26-b2fb-bc4760c5c442 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:38.090237 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e31c4900-5cae-4e26-b2fb-bc4760c5c442 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:38.090690 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e31c4900-5cae-4e26-b2fb-bc4760c5c442 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:38.211553 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-e31c4900-5cae-4e26-b2fb-bc4760c5c442 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:38.219628 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-e31c4900-5cae-4e26-b2fb-bc4760c5c442 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:38.221100 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-e31c4900-5cae-4e26-b2fb-bc4760c5c442 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:38.222233 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-e31c4900-5cae-4e26-b2fb-bc4760c5c442 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.146158 Oct 19 08:29:38.222811 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 493/994] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:38 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:39.239794 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-2c6aa0f0-cc03-41c8-a9a7-b4cec48460e2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:39.240394 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-2c6aa0f0-cc03-41c8-a9a7-b4cec48460e2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:39.246164 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2c6aa0f0-cc03-41c8-a9a7-b4cec48460e2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:39.246632 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2c6aa0f0-cc03-41c8-a9a7-b4cec48460e2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:39.247387 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2c6aa0f0-cc03-41c8-a9a7-b4cec48460e2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:39.247810 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2c6aa0f0-cc03-41c8-a9a7-b4cec48460e2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:39.365288 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-2c6aa0f0-cc03-41c8-a9a7-b4cec48460e2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:39.373489 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-2c6aa0f0-cc03-41c8-a9a7-b4cec48460e2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:39.375005 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-2c6aa0f0-cc03-41c8-a9a7-b4cec48460e2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:39.376149 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-2c6aa0f0-cc03-41c8-a9a7-b4cec48460e2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.140081 Oct 19 08:29:39.376703 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 502/995] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:39 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:40.394421 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-db16fd77-fbf9-45ac-b221-c3674a717635 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:40.395106 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-db16fd77-fbf9-45ac-b221-c3674a717635 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:40.404641 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-db16fd77-fbf9-45ac-b221-c3674a717635 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:40.405461 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-db16fd77-fbf9-45ac-b221-c3674a717635 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:40.406453 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-db16fd77-fbf9-45ac-b221-c3674a717635 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:40.407682 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-db16fd77-fbf9-45ac-b221-c3674a717635 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:40.534714 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-db16fd77-fbf9-45ac-b221-c3674a717635 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:40.543646 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-db16fd77-fbf9-45ac-b221-c3674a717635 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:40.545142 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-db16fd77-fbf9-45ac-b221-c3674a717635 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:40.546312 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-db16fd77-fbf9-45ac-b221-c3674a717635 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.155721 Oct 19 08:29:40.546900 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 494/996] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:40 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:41.563966 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a187abf3-2ce2-4fa2-9ab7-60ca95c40bbb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:41.564566 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a187abf3-2ce2-4fa2-9ab7-60ca95c40bbb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:41.570596 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a187abf3-2ce2-4fa2-9ab7-60ca95c40bbb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:41.571034 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a187abf3-2ce2-4fa2-9ab7-60ca95c40bbb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:41.571834 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a187abf3-2ce2-4fa2-9ab7-60ca95c40bbb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:41.572210 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a187abf3-2ce2-4fa2-9ab7-60ca95c40bbb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:41.690926 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a187abf3-2ce2-4fa2-9ab7-60ca95c40bbb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:41.699952 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a187abf3-2ce2-4fa2-9ab7-60ca95c40bbb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:41.701436 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a187abf3-2ce2-4fa2-9ab7-60ca95c40bbb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:41.702601 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a187abf3-2ce2-4fa2-9ab7-60ca95c40bbb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.142399 Oct 19 08:29:41.703157 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 503/997] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:41 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:42.721487 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-5b3a9b07-85ae-4057-adbb-369a8714849f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:42.722165 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-5b3a9b07-85ae-4057-adbb-369a8714849f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:42.728241 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5b3a9b07-85ae-4057-adbb-369a8714849f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:42.728695 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5b3a9b07-85ae-4057-adbb-369a8714849f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:42.729470 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5b3a9b07-85ae-4057-adbb-369a8714849f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:42.729899 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5b3a9b07-85ae-4057-adbb-369a8714849f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:42.861307 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-5b3a9b07-85ae-4057-adbb-369a8714849f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:42.876237 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-5b3a9b07-85ae-4057-adbb-369a8714849f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:42.877899 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-5b3a9b07-85ae-4057-adbb-369a8714849f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:42.879108 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-5b3a9b07-85ae-4057-adbb-369a8714849f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.161591 Oct 19 08:29:42.879698 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 495/998] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:42 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:43.897878 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-29cab283-4186-4884-a935-e6f6e3a7e66d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:43.898455 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-29cab283-4186-4884-a935-e6f6e3a7e66d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:43.904203 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-29cab283-4186-4884-a935-e6f6e3a7e66d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:43.904638 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-29cab283-4186-4884-a935-e6f6e3a7e66d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:43.905387 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-29cab283-4186-4884-a935-e6f6e3a7e66d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:43.905806 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-29cab283-4186-4884-a935-e6f6e3a7e66d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:44.028696 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-29cab283-4186-4884-a935-e6f6e3a7e66d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:44.036771 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-29cab283-4186-4884-a935-e6f6e3a7e66d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:44.038992 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-29cab283-4186-4884-a935-e6f6e3a7e66d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:44.040190 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-29cab283-4186-4884-a935-e6f6e3a7e66d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.146135 Oct 19 08:29:44.044458 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 504/999] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:43 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:45.061902 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-4e2904f6-2e6c-4342-93db-926a4f5f8d7a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:45.062545 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-4e2904f6-2e6c-4342-93db-926a4f5f8d7a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:45.068305 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4e2904f6-2e6c-4342-93db-926a4f5f8d7a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:45.068739 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4e2904f6-2e6c-4342-93db-926a4f5f8d7a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:45.069499 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4e2904f6-2e6c-4342-93db-926a4f5f8d7a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:45.069919 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4e2904f6-2e6c-4342-93db-926a4f5f8d7a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:45.196200 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-4e2904f6-2e6c-4342-93db-926a4f5f8d7a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:45.204806 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-4e2904f6-2e6c-4342-93db-926a4f5f8d7a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:45.206266 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-4e2904f6-2e6c-4342-93db-926a4f5f8d7a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:45.207591 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-4e2904f6-2e6c-4342-93db-926a4f5f8d7a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.150115 Oct 19 08:29:45.208150 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 496/1000] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:45 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:46.224721 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-f669311a-41c5-40cf-880a-c2f9e5ab83af tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:46.225259 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-f669311a-41c5-40cf-880a-c2f9e5ab83af tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:46.231010 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f669311a-41c5-40cf-880a-c2f9e5ab83af tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:46.231454 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f669311a-41c5-40cf-880a-c2f9e5ab83af tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:46.232204 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f669311a-41c5-40cf-880a-c2f9e5ab83af tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:46.232626 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f669311a-41c5-40cf-880a-c2f9e5ab83af tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:46.350820 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-f669311a-41c5-40cf-880a-c2f9e5ab83af tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:46.358986 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-f669311a-41c5-40cf-880a-c2f9e5ab83af tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:46.360463 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-f669311a-41c5-40cf-880a-c2f9e5ab83af tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:46.361607 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-f669311a-41c5-40cf-880a-c2f9e5ab83af tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.140590 Oct 19 08:29:46.362144 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 505/1001] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:46 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:47.379489 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-a0aeef4a-4737-4b69-9a85-63067c21ee11 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:47.380002 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-a0aeef4a-4737-4b69-9a85-63067c21ee11 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:47.386152 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a0aeef4a-4737-4b69-9a85-63067c21ee11 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:47.386626 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a0aeef4a-4737-4b69-9a85-63067c21ee11 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:47.387384 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a0aeef4a-4737-4b69-9a85-63067c21ee11 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:47.387811 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a0aeef4a-4737-4b69-9a85-63067c21ee11 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:47.509851 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-a0aeef4a-4737-4b69-9a85-63067c21ee11 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:47.517834 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-a0aeef4a-4737-4b69-9a85-63067c21ee11 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:47.519355 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-a0aeef4a-4737-4b69-9a85-63067c21ee11 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:47.520490 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-a0aeef4a-4737-4b69-9a85-63067c21ee11 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.144864 Oct 19 08:29:47.521038 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 497/1002] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:47 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:48.539886 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-fb58c341-69a4-44e5-8323-019689608208 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:48.540866 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-fb58c341-69a4-44e5-8323-019689608208 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:48.547056 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fb58c341-69a4-44e5-8323-019689608208 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:48.547503 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fb58c341-69a4-44e5-8323-019689608208 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:48.548289 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fb58c341-69a4-44e5-8323-019689608208 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:48.548720 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fb58c341-69a4-44e5-8323-019689608208 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:48.668548 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-fb58c341-69a4-44e5-8323-019689608208 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:48.676705 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-fb58c341-69a4-44e5-8323-019689608208 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:48.678221 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-fb58c341-69a4-44e5-8323-019689608208 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:48.679405 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-fb58c341-69a4-44e5-8323-019689608208 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.144473 Oct 19 08:29:48.680644 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 506/1003] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:48 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:49.698397 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-9d356f37-b3f1-425e-9ac3-773141c6f5e8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:49.698974 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-9d356f37-b3f1-425e-9ac3-773141c6f5e8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:49.704560 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9d356f37-b3f1-425e-9ac3-773141c6f5e8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:49.705003 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9d356f37-b3f1-425e-9ac3-773141c6f5e8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:49.705753 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9d356f37-b3f1-425e-9ac3-773141c6f5e8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:49.706178 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9d356f37-b3f1-425e-9ac3-773141c6f5e8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:49.828836 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-9d356f37-b3f1-425e-9ac3-773141c6f5e8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:49.837906 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-9d356f37-b3f1-425e-9ac3-773141c6f5e8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:49.839429 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-9d356f37-b3f1-425e-9ac3-773141c6f5e8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:49.840569 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-9d356f37-b3f1-425e-9ac3-773141c6f5e8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.146295 Oct 19 08:29:49.841114 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 498/1004] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:49 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:50.862477 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e6f6c0ce-dd88-48f9-81c1-c1a0b5ceaffe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:50.863258 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e6f6c0ce-dd88-48f9-81c1-c1a0b5ceaffe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:50.870657 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e6f6c0ce-dd88-48f9-81c1-c1a0b5ceaffe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:50.871285 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e6f6c0ce-dd88-48f9-81c1-c1a0b5ceaffe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:50.872611 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e6f6c0ce-dd88-48f9-81c1-c1a0b5ceaffe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:50.873210 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e6f6c0ce-dd88-48f9-81c1-c1a0b5ceaffe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:51.009406 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-e6f6c0ce-dd88-48f9-81c1-c1a0b5ceaffe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:51.017930 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-e6f6c0ce-dd88-48f9-81c1-c1a0b5ceaffe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:51.019587 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-e6f6c0ce-dd88-48f9-81c1-c1a0b5ceaffe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:51.021098 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e6f6c0ce-dd88-48f9-81c1-c1a0b5ceaffe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.165905 Oct 19 08:29:51.021304 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 507/1005] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:50 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:52.039786 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-cc12f305-283f-4b08-922b-a6157de6a8a6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:52.040273 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-cc12f305-283f-4b08-922b-a6157de6a8a6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:52.046096 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cc12f305-283f-4b08-922b-a6157de6a8a6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:52.046618 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cc12f305-283f-4b08-922b-a6157de6a8a6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:52.047427 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cc12f305-283f-4b08-922b-a6157de6a8a6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:52.048036 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cc12f305-283f-4b08-922b-a6157de6a8a6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:52.203042 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-cc12f305-283f-4b08-922b-a6157de6a8a6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:52.219159 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-cc12f305-283f-4b08-922b-a6157de6a8a6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:52.220492 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-cc12f305-283f-4b08-922b-a6157de6a8a6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:52.221776 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-cc12f305-283f-4b08-922b-a6157de6a8a6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.186079 Oct 19 08:29:52.222308 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 499/1006] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:52 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:53.240687 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ac9f8f45-af5d-4d0e-b566-f748fc17b9e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:53.241286 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ac9f8f45-af5d-4d0e-b566-f748fc17b9e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:53.247826 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ac9f8f45-af5d-4d0e-b566-f748fc17b9e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:53.248271 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ac9f8f45-af5d-4d0e-b566-f748fc17b9e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:53.249030 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ac9f8f45-af5d-4d0e-b566-f748fc17b9e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:53.249468 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ac9f8f45-af5d-4d0e-b566-f748fc17b9e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:53.379779 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ac9f8f45-af5d-4d0e-b566-f748fc17b9e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:53.391624 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ac9f8f45-af5d-4d0e-b566-f748fc17b9e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:53.393650 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ac9f8f45-af5d-4d0e-b566-f748fc17b9e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:53.394848 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ac9f8f45-af5d-4d0e-b566-f748fc17b9e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.157817 Oct 19 08:29:53.395407 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 508/1007] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:53 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:54.414693 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2651a2af-30b4-43cf-a8df-a46441d71da6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:54.415297 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2651a2af-30b4-43cf-a8df-a46441d71da6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:54.421525 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2651a2af-30b4-43cf-a8df-a46441d71da6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:54.421961 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2651a2af-30b4-43cf-a8df-a46441d71da6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:54.422768 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2651a2af-30b4-43cf-a8df-a46441d71da6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:54.423193 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2651a2af-30b4-43cf-a8df-a46441d71da6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:54.545953 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-2651a2af-30b4-43cf-a8df-a46441d71da6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:54.554343 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-2651a2af-30b4-43cf-a8df-a46441d71da6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:54.555868 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-2651a2af-30b4-43cf-a8df-a46441d71da6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:54.556999 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2651a2af-30b4-43cf-a8df-a46441d71da6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.147350 Oct 19 08:29:54.557546 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 500/1008] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:54 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:55.574759 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-f9d8fe96-5233-4ab9-a2eb-1f6228d672f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:55.575346 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-f9d8fe96-5233-4ab9-a2eb-1f6228d672f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:55.581051 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f9d8fe96-5233-4ab9-a2eb-1f6228d672f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:55.581490 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f9d8fe96-5233-4ab9-a2eb-1f6228d672f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:55.582228 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f9d8fe96-5233-4ab9-a2eb-1f6228d672f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:55.582674 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f9d8fe96-5233-4ab9-a2eb-1f6228d672f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:55.701813 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-f9d8fe96-5233-4ab9-a2eb-1f6228d672f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:55.709811 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-f9d8fe96-5233-4ab9-a2eb-1f6228d672f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:55.711311 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-f9d8fe96-5233-4ab9-a2eb-1f6228d672f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:55.712439 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-f9d8fe96-5233-4ab9-a2eb-1f6228d672f6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.141457 Oct 19 08:29:55.712980 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 509/1009] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:55 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:56.731841 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-751d6d13-7ebe-4ac0-9c5e-6953c05eee5e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:56.732351 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-751d6d13-7ebe-4ac0-9c5e-6953c05eee5e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:56.738153 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-751d6d13-7ebe-4ac0-9c5e-6953c05eee5e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:56.738557 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-751d6d13-7ebe-4ac0-9c5e-6953c05eee5e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:56.739310 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-751d6d13-7ebe-4ac0-9c5e-6953c05eee5e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:56.739733 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-751d6d13-7ebe-4ac0-9c5e-6953c05eee5e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:56.860886 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-751d6d13-7ebe-4ac0-9c5e-6953c05eee5e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:56.868886 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-751d6d13-7ebe-4ac0-9c5e-6953c05eee5e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:56.870356 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-751d6d13-7ebe-4ac0-9c5e-6953c05eee5e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:56.872170 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-751d6d13-7ebe-4ac0-9c5e-6953c05eee5e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.144266 Oct 19 08:29:56.872727 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 501/1010] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:56 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:57.890953 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-8138f434-320f-4265-9c89-f3b5a2c30d7b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:57.891545 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-8138f434-320f-4265-9c89-f3b5a2c30d7b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:57.897386 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8138f434-320f-4265-9c89-f3b5a2c30d7b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:57.897849 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8138f434-320f-4265-9c89-f3b5a2c30d7b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:57.898616 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8138f434-320f-4265-9c89-f3b5a2c30d7b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:57.899036 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8138f434-320f-4265-9c89-f3b5a2c30d7b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:58.016828 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-8138f434-320f-4265-9c89-f3b5a2c30d7b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:58.024956 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-8138f434-320f-4265-9c89-f3b5a2c30d7b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:58.026378 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-8138f434-320f-4265-9c89-f3b5a2c30d7b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:58.027572 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-8138f434-320f-4265-9c89-f3b5a2c30d7b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.141235 Oct 19 08:29:58.028123 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 510/1011] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:57 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:29:59.044710 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-a0d8064c-d381-440c-84d0-eab2fda3cdfe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:29:59.045307 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-a0d8064c-d381-440c-84d0-eab2fda3cdfe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:29:59.051248 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a0d8064c-d381-440c-84d0-eab2fda3cdfe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:59.051689 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a0d8064c-d381-440c-84d0-eab2fda3cdfe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:59.052450 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a0d8064c-d381-440c-84d0-eab2fda3cdfe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:29:59.052853 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a0d8064c-d381-440c-84d0-eab2fda3cdfe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:29:59.176391 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-a0d8064c-d381-440c-84d0-eab2fda3cdfe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:59.185241 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-a0d8064c-d381-440c-84d0-eab2fda3cdfe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:59.186792 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-a0d8064c-d381-440c-84d0-eab2fda3cdfe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:29:59.187945 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-a0d8064c-d381-440c-84d0-eab2fda3cdfe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.146890 Oct 19 08:29:59.188509 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 502/1012] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:29:59 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:30:00.205710 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a8cb9ac6-eafe-42ac-93fc-a722eb8c5fec tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:30:00.206295 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a8cb9ac6-eafe-42ac-93fc-a722eb8c5fec tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:30:00.212349 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a8cb9ac6-eafe-42ac-93fc-a722eb8c5fec tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:00.212792 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a8cb9ac6-eafe-42ac-93fc-a722eb8c5fec tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:00.213662 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a8cb9ac6-eafe-42ac-93fc-a722eb8c5fec tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:00.214095 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a8cb9ac6-eafe-42ac-93fc-a722eb8c5fec tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:00.333419 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a8cb9ac6-eafe-42ac-93fc-a722eb8c5fec tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:00.342398 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a8cb9ac6-eafe-42ac-93fc-a722eb8c5fec tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:00.343914 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a8cb9ac6-eafe-42ac-93fc-a722eb8c5fec tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:00.345116 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a8cb9ac6-eafe-42ac-93fc-a722eb8c5fec tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.143235 Oct 19 08:30:00.345668 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 511/1013] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:30:00 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:30:01.362611 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-5f67864c-d4f8-4d45-811a-45386a4712ba tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:30:01.363199 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-5f67864c-d4f8-4d45-811a-45386a4712ba tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:30:01.368955 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5f67864c-d4f8-4d45-811a-45386a4712ba tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:01.369331 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5f67864c-d4f8-4d45-811a-45386a4712ba tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:01.370073 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5f67864c-d4f8-4d45-811a-45386a4712ba tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:01.370513 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5f67864c-d4f8-4d45-811a-45386a4712ba tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:01.488976 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-5f67864c-d4f8-4d45-811a-45386a4712ba tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:01.497775 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-5f67864c-d4f8-4d45-811a-45386a4712ba tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:01.499285 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-5f67864c-d4f8-4d45-811a-45386a4712ba tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:01.500427 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-5f67864c-d4f8-4d45-811a-45386a4712ba tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.141454 Oct 19 08:30:01.500976 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 503/1014] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:30:01 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:30:02.519092 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e06f624b-c19f-45ee-946a-fea0810479de tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:30:02.519615 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e06f624b-c19f-45ee-946a-fea0810479de tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:30:02.525427 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e06f624b-c19f-45ee-946a-fea0810479de tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:02.525886 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e06f624b-c19f-45ee-946a-fea0810479de tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:02.526655 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e06f624b-c19f-45ee-946a-fea0810479de tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:02.527084 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e06f624b-c19f-45ee-946a-fea0810479de tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:02.646963 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-e06f624b-c19f-45ee-946a-fea0810479de tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:02.655590 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-e06f624b-c19f-45ee-946a-fea0810479de tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:02.657082 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-e06f624b-c19f-45ee-946a-fea0810479de tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:02.658223 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e06f624b-c19f-45ee-946a-fea0810479de tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.142864 Oct 19 08:30:02.658808 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 512/1015] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:30:02 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:30:03.675958 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-742efeda-d955-46eb-8ebb-ddf69adcccf1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:30:03.676550 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-742efeda-d955-46eb-8ebb-ddf69adcccf1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:30:03.682332 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-742efeda-d955-46eb-8ebb-ddf69adcccf1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:03.682803 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-742efeda-d955-46eb-8ebb-ddf69adcccf1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:03.683549 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-742efeda-d955-46eb-8ebb-ddf69adcccf1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:03.683971 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-742efeda-d955-46eb-8ebb-ddf69adcccf1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:03.802590 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-742efeda-d955-46eb-8ebb-ddf69adcccf1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:03.810715 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-742efeda-d955-46eb-8ebb-ddf69adcccf1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:03.812183 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-742efeda-d955-46eb-8ebb-ddf69adcccf1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:03.813313 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-742efeda-d955-46eb-8ebb-ddf69adcccf1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.141084 Oct 19 08:30:03.813860 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 504/1016] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:30:03 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:30:04.831981 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-84acdd86-67d8-4f46-b1a9-aed5cc24a019 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:30:04.832575 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-84acdd86-67d8-4f46-b1a9-aed5cc24a019 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:30:04.838175 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-84acdd86-67d8-4f46-b1a9-aed5cc24a019 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:04.838653 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-84acdd86-67d8-4f46-b1a9-aed5cc24a019 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:04.839396 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-84acdd86-67d8-4f46-b1a9-aed5cc24a019 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:04.839813 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-84acdd86-67d8-4f46-b1a9-aed5cc24a019 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:04.958643 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-84acdd86-67d8-4f46-b1a9-aed5cc24a019 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:04.967202 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-84acdd86-67d8-4f46-b1a9-aed5cc24a019 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:04.968674 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-84acdd86-67d8-4f46-b1a9-aed5cc24a019 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:04.969795 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-84acdd86-67d8-4f46-b1a9-aed5cc24a019 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.141487 Oct 19 08:30:04.970342 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 513/1017] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:30:04 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:30:05.987689 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-3ebee89b-c9c2-4efb-92f4-dd05f2b7d2f4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:30:05.988270 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-3ebee89b-c9c2-4efb-92f4-dd05f2b7d2f4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:30:05.993944 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3ebee89b-c9c2-4efb-92f4-dd05f2b7d2f4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:05.994382 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3ebee89b-c9c2-4efb-92f4-dd05f2b7d2f4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:05.995165 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3ebee89b-c9c2-4efb-92f4-dd05f2b7d2f4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:05.995594 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3ebee89b-c9c2-4efb-92f4-dd05f2b7d2f4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:06.116804 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-3ebee89b-c9c2-4efb-92f4-dd05f2b7d2f4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:06.125474 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-3ebee89b-c9c2-4efb-92f4-dd05f2b7d2f4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:06.127018 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-3ebee89b-c9c2-4efb-92f4-dd05f2b7d2f4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:06.128164 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-3ebee89b-c9c2-4efb-92f4-dd05f2b7d2f4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.144279 Oct 19 08:30:06.128712 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 505/1018] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:30:05 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:30:07.146257 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-5b3299d8-b335-400f-b013-054847e2738e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:30:07.146887 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-5b3299d8-b335-400f-b013-054847e2738e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:30:07.152707 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5b3299d8-b335-400f-b013-054847e2738e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:07.153796 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5b3299d8-b335-400f-b013-054847e2738e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:07.154575 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5b3299d8-b335-400f-b013-054847e2738e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:07.155000 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5b3299d8-b335-400f-b013-054847e2738e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:07.271628 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-5b3299d8-b335-400f-b013-054847e2738e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:07.280397 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-5b3299d8-b335-400f-b013-054847e2738e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:07.281919 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-5b3299d8-b335-400f-b013-054847e2738e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:07.283098 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-5b3299d8-b335-400f-b013-054847e2738e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.140535 Oct 19 08:30:07.283904 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 514/1019] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:30:07 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:30:08.300870 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-04a4d746-b181-4418-819e-90f302698e69 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:30:08.301480 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-04a4d746-b181-4418-819e-90f302698e69 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:30:08.307285 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-04a4d746-b181-4418-819e-90f302698e69 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:08.307729 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-04a4d746-b181-4418-819e-90f302698e69 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:08.308587 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-04a4d746-b181-4418-819e-90f302698e69 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:08.308911 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-04a4d746-b181-4418-819e-90f302698e69 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:08.433247 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-04a4d746-b181-4418-819e-90f302698e69 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:08.441972 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-04a4d746-b181-4418-819e-90f302698e69 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:08.443475 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-04a4d746-b181-4418-819e-90f302698e69 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:08.444648 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-04a4d746-b181-4418-819e-90f302698e69 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.147521 Oct 19 08:30:08.445221 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 506/1020] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:30:08 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:30:09.315602 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-a6aa4d35-deaa-443c-9f6e-4de05d35a8c5 req-0134ea3a-3497-48b9-913d-002a31f67b28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7dae80-4592-45ea-a52d-05aa559c102a", "name": "network-vif-plugged", "status": "completed", "tag": "3ccfabb1-82b3-4904-a943-c29622e0b546"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:30:09.317151 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:30:09.317151 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:30:09.323729 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-a6aa4d35-deaa-443c-9f6e-4de05d35a8c5 req-0134ea3a-3497-48b9-913d-002a31f67b28 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:09.324160 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-a6aa4d35-deaa-443c-9f6e-4de05d35a8c5 req-0134ea3a-3497-48b9-913d-002a31f67b28 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:09.334854 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-a6aa4d35-deaa-443c-9f6e-4de05d35a8c5 req-0134ea3a-3497-48b9-913d-002a31f67b28 service nova] Creating event network-vif-plugged:3ccfabb1-82b3-4904-a943-c29622e0b546 for instance fe7dae80-4592-45ea-a52d-05aa559c102a on hv-cinder-81398 Oct 19 08:30:09.339957 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-a6aa4d35-deaa-443c-9f6e-4de05d35a8c5 req-0134ea3a-3497-48b9-913d-002a31f67b28 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141275 Oct 19 08:30:09.340915 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 515/1021] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:30:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:30:09.464879 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-83cad365-0b11-46b2-b0a8-c8b6d110c469 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:30:09.465473 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-83cad365-0b11-46b2-b0a8-c8b6d110c469 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:30:09.471703 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-83cad365-0b11-46b2-b0a8-c8b6d110c469 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:09.472144 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-83cad365-0b11-46b2-b0a8-c8b6d110c469 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:09.472890 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-83cad365-0b11-46b2-b0a8-c8b6d110c469 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:09.473312 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-83cad365-0b11-46b2-b0a8-c8b6d110c469 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:09.594764 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-83cad365-0b11-46b2-b0a8-c8b6d110c469 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:09.602891 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-83cad365-0b11-46b2-b0a8-c8b6d110c469 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:09.604367 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-83cad365-0b11-46b2-b0a8-c8b6d110c469 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:09.605498 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-83cad365-0b11-46b2-b0a8-c8b6d110c469 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.144334 Oct 19 08:30:09.606040 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 507/1022] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:30:09 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:30:10.625659 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-8abad80e-1a2a-4e66-81a1-f70aa23d9ea2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:30:10.626384 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-8abad80e-1a2a-4e66-81a1-f70aa23d9ea2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:30:10.633020 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8abad80e-1a2a-4e66-81a1-f70aa23d9ea2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:10.633500 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8abad80e-1a2a-4e66-81a1-f70aa23d9ea2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:10.634635 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8abad80e-1a2a-4e66-81a1-f70aa23d9ea2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:10.635066 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8abad80e-1a2a-4e66-81a1-f70aa23d9ea2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:10.820993 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-8abad80e-1a2a-4e66-81a1-f70aa23d9ea2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:10.832873 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-8abad80e-1a2a-4e66-81a1-f70aa23d9ea2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:10.834605 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-8abad80e-1a2a-4e66-81a1-f70aa23d9ea2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:10.836012 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-8abad80e-1a2a-4e66-81a1-f70aa23d9ea2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.215457 Oct 19 08:30:10.836857 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 516/1023] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:30:10 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:30:11.853693 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-6c3becbd-2a93-46b6-94ce-58d72bf1e4ac tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:30:11.855035 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-6c3becbd-2a93-46b6-94ce-58d72bf1e4ac tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:30:11.861919 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6c3becbd-2a93-46b6-94ce-58d72bf1e4ac tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:11.866400 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6c3becbd-2a93-46b6-94ce-58d72bf1e4ac tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:11.867199 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6c3becbd-2a93-46b6-94ce-58d72bf1e4ac tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:11.867610 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6c3becbd-2a93-46b6-94ce-58d72bf1e4ac tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:12.041375 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-6c3becbd-2a93-46b6-94ce-58d72bf1e4ac tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:12.049718 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-6c3becbd-2a93-46b6-94ce-58d72bf1e4ac tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:12.051742 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-6c3becbd-2a93-46b6-94ce-58d72bf1e4ac tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:12.053255 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-6c3becbd-2a93-46b6-94ce-58d72bf1e4ac tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.203157 Oct 19 08:30:12.054375 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 508/1024] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:30:11 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:30:13.073077 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-d678a435-0e3e-4f5d-baa4-c52b8c17d970 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:30:13.073679 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-d678a435-0e3e-4f5d-baa4-c52b8c17d970 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:30:13.080317 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d678a435-0e3e-4f5d-baa4-c52b8c17d970 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:13.080771 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d678a435-0e3e-4f5d-baa4-c52b8c17d970 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:13.081544 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d678a435-0e3e-4f5d-baa4-c52b8c17d970 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:13.081975 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d678a435-0e3e-4f5d-baa4-c52b8c17d970 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:13.257135 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-d678a435-0e3e-4f5d-baa4-c52b8c17d970 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:13.266055 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-d678a435-0e3e-4f5d-baa4-c52b8c17d970 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:13.267752 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-d678a435-0e3e-4f5d-baa4-c52b8c17d970 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:13.269041 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-d678a435-0e3e-4f5d-baa4-c52b8c17d970 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.199951 Oct 19 08:30:13.269587 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 517/1025] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:30:13 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:30:14.288989 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-bd655693-fe06-4604-8947-a4b47b12eafb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:30:14.289718 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-bd655693-fe06-4604-8947-a4b47b12eafb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:30:14.295619 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bd655693-fe06-4604-8947-a4b47b12eafb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:14.296474 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bd655693-fe06-4604-8947-a4b47b12eafb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:14.296836 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bd655693-fe06-4604-8947-a4b47b12eafb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:14.297266 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bd655693-fe06-4604-8947-a4b47b12eafb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:14.428612 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-bd655693-fe06-4604-8947-a4b47b12eafb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:14.437539 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-bd655693-fe06-4604-8947-a4b47b12eafb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:14.439058 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-bd655693-fe06-4604-8947-a4b47b12eafb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:14.440205 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-bd655693-fe06-4604-8947-a4b47b12eafb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.155479 Oct 19 08:30:14.440755 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 509/1026] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:30:14 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:30:15.457521 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-42c779dc-746c-4bba-b297-fc5d6320f8e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:30:15.458123 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-42c779dc-746c-4bba-b297-fc5d6320f8e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:30:15.463918 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-42c779dc-746c-4bba-b297-fc5d6320f8e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:15.464338 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-42c779dc-746c-4bba-b297-fc5d6320f8e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:15.465107 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-42c779dc-746c-4bba-b297-fc5d6320f8e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:15.465594 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-42c779dc-746c-4bba-b297-fc5d6320f8e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:15.613606 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-42c779dc-746c-4bba-b297-fc5d6320f8e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:15.624836 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-42c779dc-746c-4bba-b297-fc5d6320f8e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:15.626327 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-42c779dc-746c-4bba-b297-fc5d6320f8e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:15.627605 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-42c779dc-746c-4bba-b297-fc5d6320f8e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1810 microversion: 2.20 time: 0.173834 Oct 19 08:30:15.628206 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 518/1027] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:30:15 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:30:16.648122 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-6c230d12-bd6d-4a54-bfca-143ce72d597d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:30:16.649427 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-6c230d12-bd6d-4a54-bfca-143ce72d597d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:30:16.655967 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6c230d12-bd6d-4a54-bfca-143ce72d597d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:16.656421 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6c230d12-bd6d-4a54-bfca-143ce72d597d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:16.657191 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6c230d12-bd6d-4a54-bfca-143ce72d597d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:16.657620 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6c230d12-bd6d-4a54-bfca-143ce72d597d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:16.850533 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-6c230d12-bd6d-4a54-bfca-143ce72d597d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:16.863009 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-6c230d12-bd6d-4a54-bfca-143ce72d597d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:16.865353 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-6c230d12-bd6d-4a54-bfca-143ce72d597d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:30:16.866976 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-6c230d12-bd6d-4a54-bfca-143ce72d597d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1797 microversion: 2.20 time: 0.222449 Oct 19 08:30:16.875163 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 510/1028] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:30:16 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1797 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:30:33.716136 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-89a2f132-6def-459f-a039-d3b09adfb9fc tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Action: 'create', calling method: .version_select at 0x7fcadd97db80>, body: {"keypair": {"name": "tempest-TestShelveInstance-118533541"}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:30:33.754645 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-89a2f132-6def-459f-a039-d3b09adfb9fc tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Getting quotas for project 4c35a609df154c65988d39d98e9f50c8. Resources: {'key_pairs'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:30:33.760139 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-89a2f132-6def-459f-a039-d3b09adfb9fc tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Getting quotas for user d215d02d64fc47ae988b63aca21203a0 and project 4c35a609df154c65988d39d98e9f50c8. Resources: {'key_pairs'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:30:34.227358 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-89a2f132-6def-459f-a039-d3b09adfb9fc tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Getting quotas for project 4c35a609df154c65988d39d98e9f50c8. Resources: {'key_pairs'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:30:34.239118 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-89a2f132-6def-459f-a039-d3b09adfb9fc tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Getting quotas for user d215d02d64fc47ae988b63aca21203a0 and project 4c35a609df154c65988d39d98e9f50c8. Resources: {'key_pairs'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:30:34.254028 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-89a2f132-6def-459f-a039-d3b09adfb9fc tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.802703 Oct 19 08:30:34.255239 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 519/1029] 10.222.0.26 () {60 vars in 1157 bytes} [Tue Oct 19 08:30:33 2021] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:30:36.101472 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-1acc6d7b-34e0-4d7b-980f-6fe2a9ee4c9f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Action: 'create', calling method: .version_select at 0x7fcadd12fe50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-200438871"}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:30:36.139689 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-1acc6d7b-34e0-4d7b-980f-6fe2a9ee4c9f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Getting quotas for project 28ca19e490b045a8af80ce6bc64afa50. Resources: {'key_pairs'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:30:36.146554 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-1acc6d7b-34e0-4d7b-980f-6fe2a9ee4c9f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Getting quotas for user 2c83b4f13a67443b90711ef61e4685a6 and project 28ca19e490b045a8af80ce6bc64afa50. Resources: {'key_pairs'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:30:36.162566 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1acc6d7b-34e0-4d7b-980f-6fe2a9ee4c9f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [9c57a5fe-a8a1-4f78-aa9f-55b174745558] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 08:30:37.184563 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO oslo.messaging._drivers.impl_rabbit [None req-1acc6d7b-34e0-4d7b-980f-6fe2a9ee4c9f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [9c57a5fe-a8a1-4f78-aa9f-55b174745558] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 55802. Oct 19 08:30:37.344406 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-1acc6d7b-34e0-4d7b-980f-6fe2a9ee4c9f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Getting quotas for project 28ca19e490b045a8af80ce6bc64afa50. Resources: {'key_pairs'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:30:37.348407 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-1acc6d7b-34e0-4d7b-980f-6fe2a9ee4c9f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Getting quotas for user 2c83b4f13a67443b90711ef61e4685a6 and project 28ca19e490b045a8af80ce6bc64afa50. Resources: {'key_pairs'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:30:37.370454 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-1acc6d7b-34e0-4d7b-980f-6fe2a9ee4c9f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 1.531877 Oct 19 08:30:37.373672 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 511/1030] 10.222.0.26 () {60 vars in 1157 bytes} [Tue Oct 19 08:30:35 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:30:59.231524 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-bb996387-063c-4e79-80a2-a1cd3d0d1961 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:30:59.232219 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-bb996387-063c-4e79-80a2-a1cd3d0d1961 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:30:59.238597 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bb996387-063c-4e79-80a2-a1cd3d0d1961 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:59.239036 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bb996387-063c-4e79-80a2-a1cd3d0d1961 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:59.239808 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bb996387-063c-4e79-80a2-a1cd3d0d1961 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:30:59.240231 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bb996387-063c-4e79-80a2-a1cd3d0d1961 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:30:59.315843 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.objects.instance [None req-bb996387-063c-4e79-80a2-a1cd3d0d1961 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lazy-loading 'services' on Instance uuid 30b1ba9b-8d31-4658-9d03-3be46d4f7504 {{(pid=114106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 19 08:30:59.385415 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-bb996387-063c-4e79-80a2-a1cd3d0d1961 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "DELETE /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/os-volume_attachments/a877fbe9-49f9-44a7-8a11-8235a045a2f6" status: 202 len: 0 microversion: 2.1 time: 0.251218 Oct 19 08:30:59.386006 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 520/1031] 10.222.0.26 () {58 vars in 1415 bytes} [Tue Oct 19 08:30:59 2021] DELETE /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/os-volume_attachments/a877fbe9-49f9-44a7-8a11-8235a045a2f6 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:31:05.742305 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-0b059e66-e4ba-437c-8567-bb717cf18f2c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:31:05.748968 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0b059e66-e4ba-437c-8567-bb717cf18f2c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:05.749406 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0b059e66-e4ba-437c-8567-bb717cf18f2c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:05.772910 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-0b059e66-e4ba-437c-8567-bb717cf18f2c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Going to try to stop instance {{(pid=114105) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 19 08:31:05.815896 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-0b059e66-e4ba-437c-8567-bb717cf18f2c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 202 len: 0 microversion: 2.1 time: 0.077286 Oct 19 08:31:05.816821 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 512/1032] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:31:05 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:31:05.825657 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-0fe6cb8b-c8af-4122-a298-71c12adcf6aa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:05.826416 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-0fe6cb8b-c8af-4122-a298-71c12adcf6aa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:05.834553 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0fe6cb8b-c8af-4122-a298-71c12adcf6aa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:05.835349 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0fe6cb8b-c8af-4122-a298-71c12adcf6aa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:05.836779 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0fe6cb8b-c8af-4122-a298-71c12adcf6aa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:05.837265 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0fe6cb8b-c8af-4122-a298-71c12adcf6aa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:06.027925 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-0fe6cb8b-c8af-4122-a298-71c12adcf6aa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:06.035805 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-0fe6cb8b-c8af-4122-a298-71c12adcf6aa tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1676 microversion: 2.1 time: 0.214559 Oct 19 08:31:06.036376 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 521/1033] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:05 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1676 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:07.054316 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-602a7e73-5818-45d0-abc9-7c2e84dd2332 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:07.055102 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-602a7e73-5818-45d0-abc9-7c2e84dd2332 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:07.061126 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-602a7e73-5818-45d0-abc9-7c2e84dd2332 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:07.061765 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-602a7e73-5818-45d0-abc9-7c2e84dd2332 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:07.062732 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-602a7e73-5818-45d0-abc9-7c2e84dd2332 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:07.063166 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-602a7e73-5818-45d0-abc9-7c2e84dd2332 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:07.339599 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-602a7e73-5818-45d0-abc9-7c2e84dd2332 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:07.348397 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-602a7e73-5818-45d0-abc9-7c2e84dd2332 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1676 microversion: 2.1 time: 0.298010 Oct 19 08:31:07.348994 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 513/1034] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:07 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1676 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:08.365098 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-376e012f-ec02-43cd-848b-7caeeac77816 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:08.367080 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-376e012f-ec02-43cd-848b-7caeeac77816 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:08.372999 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-376e012f-ec02-43cd-848b-7caeeac77816 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:08.373639 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-376e012f-ec02-43cd-848b-7caeeac77816 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:08.374605 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-376e012f-ec02-43cd-848b-7caeeac77816 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:08.375188 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-376e012f-ec02-43cd-848b-7caeeac77816 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:08.516182 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-376e012f-ec02-43cd-848b-7caeeac77816 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:08.523588 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-376e012f-ec02-43cd-848b-7caeeac77816 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1676 microversion: 2.1 time: 0.162093 Oct 19 08:31:08.524147 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 522/1035] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:08 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:09.540713 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-7dce1fe5-17f3-4c86-acae-80b34d47fc57 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:09.541312 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-7dce1fe5-17f3-4c86-acae-80b34d47fc57 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:09.547625 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7dce1fe5-17f3-4c86-acae-80b34d47fc57 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:09.548294 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7dce1fe5-17f3-4c86-acae-80b34d47fc57 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:09.549623 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7dce1fe5-17f3-4c86-acae-80b34d47fc57 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:09.550577 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7dce1fe5-17f3-4c86-acae-80b34d47fc57 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:09.703223 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-7dce1fe5-17f3-4c86-acae-80b34d47fc57 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:09.714789 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-7dce1fe5-17f3-4c86-acae-80b34d47fc57 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1676 microversion: 2.1 time: 0.177732 Oct 19 08:31:09.716144 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 514/1036] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:09 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:10.735669 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-4906f6cf-4bc6-4b71-a2bf-8b592b59210c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:10.736659 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-4906f6cf-4bc6-4b71-a2bf-8b592b59210c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:10.743996 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4906f6cf-4bc6-4b71-a2bf-8b592b59210c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:10.744434 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4906f6cf-4bc6-4b71-a2bf-8b592b59210c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:10.745224 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4906f6cf-4bc6-4b71-a2bf-8b592b59210c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:10.745653 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4906f6cf-4bc6-4b71-a2bf-8b592b59210c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:10.886438 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-4906f6cf-4bc6-4b71-a2bf-8b592b59210c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:10.895465 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-4906f6cf-4bc6-4b71-a2bf-8b592b59210c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1676 microversion: 2.1 time: 0.166501 Oct 19 08:31:10.896715 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 523/1037] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:10 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:11.913110 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8d41bfc0-26b2-47c9-90ce-feffbbf693e5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:11.913704 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-8d41bfc0-26b2-47c9-90ce-feffbbf693e5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:11.919624 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8d41bfc0-26b2-47c9-90ce-feffbbf693e5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:11.920073 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8d41bfc0-26b2-47c9-90ce-feffbbf693e5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:11.921890 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8d41bfc0-26b2-47c9-90ce-feffbbf693e5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:11.922329 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8d41bfc0-26b2-47c9-90ce-feffbbf693e5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:12.215965 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-8d41bfc0-26b2-47c9-90ce-feffbbf693e5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:12.229085 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-8d41bfc0-26b2-47c9-90ce-feffbbf693e5 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1676 microversion: 2.1 time: 0.319690 Oct 19 08:31:12.230319 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 515/1038] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:11 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1676 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:12.580917 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-d1d2ac10-5b37-4df8-b479-d43a629986d7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1967692254", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-118533541", "security_groups": [{"name": "tempest-secgroup-smoke-1519316107"}], "networks": [{"uuid": "fb031b3e-c52c-423e-8e10-3f31ca90acd6"}], "block_device_mapping_v2": [{"uuid": "f303aecd-3589-43ab-b1cb-72bbf3e5d87c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:31:12.744756 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.network.neutron [None req-d1d2ac10-5b37-4df8-b479-d43a629986d7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] validate_networks() for [('fb031b3e-c52c-423e-8e10-3f31ca90acd6', None, None, None, None, None)] {{(pid=114106) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 19 08:31:13.248028 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d4afa151-4daf-4261-8c11-11b2e2b6bf93 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:13.248728 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-d4afa151-4daf-4261-8c11-11b2e2b6bf93 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:13.258973 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d4afa151-4daf-4261-8c11-11b2e2b6bf93 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:13.263450 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d4afa151-4daf-4261-8c11-11b2e2b6bf93 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:13.264630 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d4afa151-4daf-4261-8c11-11b2e2b6bf93 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:13.267632 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d4afa151-4daf-4261-8c11-11b2e2b6bf93 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:13.922195 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-d4afa151-4daf-4261-8c11-11b2e2b6bf93 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:13.930565 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-d4afa151-4daf-4261-8c11-11b2e2b6bf93 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1676 microversion: 2.1 time: 0.686790 Oct 19 08:31:13.936586 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 516/1039] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:13 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1676 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:14.172872 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-d1d2ac10-5b37-4df8-b479-d43a629986d7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Flavor limits 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 08:31:14.176068 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-d1d2ac10-5b37-4df8-b479-d43a629986d7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Image limits 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 08:31:14.177130 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-d1d2ac10-5b37-4df8-b479-d43a629986d7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Flavor pref 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 08:31:14.177736 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-d1d2ac10-5b37-4df8-b479-d43a629986d7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Image pref 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 08:31:14.178386 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-d1d2ac10-5b37-4df8-b479-d43a629986d7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 08:31:14.194441 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d1d2ac10-5b37-4df8-b479-d43a629986d7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:14.194970 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d1d2ac10-5b37-4df8-b479-d43a629986d7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:14.196093 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d1d2ac10-5b37-4df8-b479-d43a629986d7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:14.196696 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d1d2ac10-5b37-4df8-b479-d43a629986d7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:14.220272 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-d1d2ac10-5b37-4df8-b479-d43a629986d7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Getting quotas for project 4c35a609df154c65988d39d98e9f50c8. Resources: {'cores', 'instances', 'ram'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:31:14.227641 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-d1d2ac10-5b37-4df8-b479-d43a629986d7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Getting quotas for user d215d02d64fc47ae988b63aca21203a0 and project 4c35a609df154c65988d39d98e9f50c8. Resources: {'cores', 'instances', 'ram'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:31:14.303639 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-d1d2ac10-5b37-4df8-b479-d43a629986d7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Going to run 1 instances... {{(pid=114106) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 19 08:31:14.306704 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-d1d2ac10-5b37-4df8-b479-d43a629986d7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f303aecd-3589-43ab-b1cb-72bbf3e5d87c',volume_size=None,volume_type=None)] {{(pid=114106) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 19 08:31:14.452841 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-d1d2ac10-5b37-4df8-b479-d43a629986d7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.875663 Oct 19 08:31:14.459484 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 524/1040] 10.222.0.26 () {60 vars in 1146 bytes} [Tue Oct 19 08:31:12 2021] POST /compute/v2.1/servers => generated 406 bytes in 1882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 08:31:14.465510 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-dd4eb0ab-11da-4a9a-a54f-06a9d2fea108 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:14.466770 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-dd4eb0ab-11da-4a9a-a54f-06a9d2fea108 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:14.576495 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-dd4eb0ab-11da-4a9a-a54f-06a9d2fea108 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:14.588827 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-dd4eb0ab-11da-4a9a-a54f-06a9d2fea108 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1088 microversion: 2.1 time: 0.127185 Oct 19 08:31:14.604704 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 517/1041] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:14 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1088 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:14.897236 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-f401fd21-cf59-412c-be2c-afdd58d81abc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1560823377", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-200438871", "security_groups": [{"name": "tempest-secgroup-smoke-740896653"}], "block_device_mapping_v2": [{"uuid": "36e0be22-0965-4a26-9d77-009121a7d2dd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "09e1e2e2-02ec-4078-9b6b-9e1d757336b7"}]}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:31:14.948499 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-39c02adc-74c0-4d7b-a740-df638e551e55 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:14.949469 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-39c02adc-74c0-4d7b-a740-df638e551e55 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:14.959593 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-39c02adc-74c0-4d7b-a740-df638e551e55 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:14.961795 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-39c02adc-74c0-4d7b-a740-df638e551e55 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:14.963082 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-39c02adc-74c0-4d7b-a740-df638e551e55 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:14.965754 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-39c02adc-74c0-4d7b-a740-df638e551e55 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:15.144978 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.network.neutron [None req-f401fd21-cf59-412c-be2c-afdd58d81abc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] validate_networks() for [('09e1e2e2-02ec-4078-9b6b-9e1d757336b7', None, None, None, None, None)] {{(pid=114106) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 19 08:31:15.318259 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-39c02adc-74c0-4d7b-a740-df638e551e55 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:15.325792 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-39c02adc-74c0-4d7b-a740-df638e551e55 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1676 microversion: 2.1 time: 0.380864 Oct 19 08:31:15.326440 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 518/1042] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:14 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1676 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:15.607004 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-65abec30-d0c1-4e26-8bb6-04e83e005a00 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:15.607647 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-65abec30-d0c1-4e26-8bb6-04e83e005a00 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:15.614886 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-65abec30-d0c1-4e26-8bb6-04e83e005a00 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:15.615530 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-65abec30-d0c1-4e26-8bb6-04e83e005a00 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:15.616733 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-65abec30-d0c1-4e26-8bb6-04e83e005a00 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:15.617312 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-65abec30-d0c1-4e26-8bb6-04e83e005a00 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:15.791241 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-65abec30-d0c1-4e26-8bb6-04e83e005a00 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:15.801425 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-65abec30-d0c1-4e26-8bb6-04e83e005a00 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1194 microversion: 2.1 time: 0.198190 Oct 19 08:31:15.807452 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 519/1043] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:15 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1194 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:16.105013 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-f401fd21-cf59-412c-be2c-afdd58d81abc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Flavor limits 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 08:31:16.106173 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-f401fd21-cf59-412c-be2c-afdd58d81abc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Image limits 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 08:31:16.106771 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-f401fd21-cf59-412c-be2c-afdd58d81abc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Flavor pref 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 08:31:16.107391 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-f401fd21-cf59-412c-be2c-afdd58d81abc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Image pref 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 08:31:16.107802 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-f401fd21-cf59-412c-be2c-afdd58d81abc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 08:31:16.127921 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f401fd21-cf59-412c-be2c-afdd58d81abc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:16.128357 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f401fd21-cf59-412c-be2c-afdd58d81abc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:16.129269 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f401fd21-cf59-412c-be2c-afdd58d81abc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:16.129895 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f401fd21-cf59-412c-be2c-afdd58d81abc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:16.151539 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-f401fd21-cf59-412c-be2c-afdd58d81abc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Getting quotas for project 28ca19e490b045a8af80ce6bc64afa50. Resources: {'cores', 'instances', 'ram'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:31:16.156729 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-f401fd21-cf59-412c-be2c-afdd58d81abc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Getting quotas for user 2c83b4f13a67443b90711ef61e4685a6 and project 28ca19e490b045a8af80ce6bc64afa50. Resources: {'cores', 'instances', 'ram'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:31:16.248206 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-f401fd21-cf59-412c-be2c-afdd58d81abc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Going to run 1 instances... {{(pid=114106) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 19 08:31:16.250682 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-f401fd21-cf59-412c-be2c-afdd58d81abc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='36e0be22-0965-4a26-9d77-009121a7d2dd',volume_size=None,volume_type=None)] {{(pid=114106) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 19 08:31:16.342958 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8085d1ba-3819-45d9-90b6-d186cc101c7b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:16.343812 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-8085d1ba-3819-45d9-90b6-d186cc101c7b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:16.355942 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8085d1ba-3819-45d9-90b6-d186cc101c7b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:16.356997 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8085d1ba-3819-45d9-90b6-d186cc101c7b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:16.358644 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8085d1ba-3819-45d9-90b6-d186cc101c7b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:16.359606 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8085d1ba-3819-45d9-90b6-d186cc101c7b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:16.473327 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-f401fd21-cf59-412c-be2c-afdd58d81abc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.579808 Oct 19 08:31:16.474684 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 525/1044] 10.222.0.26 () {60 vars in 1146 bytes} [Tue Oct 19 08:31:14 2021] POST /compute/v2.1/servers => generated 405 bytes in 1582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 08:31:16.485919 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-2a54fffd-8157-4284-a925-30beec734d3e tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:16.486647 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-2a54fffd-8157-4284-a925-30beec734d3e tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:16.569449 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-2a54fffd-8157-4284-a925-30beec734d3e tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:16.578155 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-2a54fffd-8157-4284-a925-30beec734d3e tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1094 microversion: 2.1 time: 0.096270 Oct 19 08:31:16.579291 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 526/1045] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:16 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1094 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:16.648305 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-8085d1ba-3819-45d9-90b6-d186cc101c7b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:16.663215 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-8085d1ba-3819-45d9-90b6-d186cc101c7b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1676 microversion: 2.1 time: 0.323787 Oct 19 08:31:16.663809 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 520/1046] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:16 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1676 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:31:16.823434 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c1ac4a16-1f63-4064-800d-42915c6a573d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:16.824537 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c1ac4a16-1f63-4064-800d-42915c6a573d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:16.839389 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c1ac4a16-1f63-4064-800d-42915c6a573d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:16.839681 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c1ac4a16-1f63-4064-800d-42915c6a573d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:16.840450 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c1ac4a16-1f63-4064-800d-42915c6a573d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:16.850012 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c1ac4a16-1f63-4064-800d-42915c6a573d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:16.935868 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-c1ac4a16-1f63-4064-800d-42915c6a573d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:16.948939 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c1ac4a16-1f63-4064-800d-42915c6a573d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1192 microversion: 2.1 time: 0.127417 Oct 19 08:31:16.949785 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 527/1047] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:16 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1192 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:17.606317 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-171b71da-9619-4630-b6fd-92dfe63a1f95 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:17.607951 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-171b71da-9619-4630-b6fd-92dfe63a1f95 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:17.615666 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-171b71da-9619-4630-b6fd-92dfe63a1f95 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:17.616456 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-171b71da-9619-4630-b6fd-92dfe63a1f95 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:17.617453 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-171b71da-9619-4630-b6fd-92dfe63a1f95 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:17.618103 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-171b71da-9619-4630-b6fd-92dfe63a1f95 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:17.690445 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ee5c8b61-5300-43a4-91ed-b044829ad048 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:17.691445 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ee5c8b61-5300-43a4-91ed-b044829ad048 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:17.706780 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ee5c8b61-5300-43a4-91ed-b044829ad048 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:17.707752 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ee5c8b61-5300-43a4-91ed-b044829ad048 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:17.708806 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ee5c8b61-5300-43a4-91ed-b044829ad048 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:17.709457 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ee5c8b61-5300-43a4-91ed-b044829ad048 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:17.790131 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-171b71da-9619-4630-b6fd-92dfe63a1f95 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:17.802069 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-171b71da-9619-4630-b6fd-92dfe63a1f95 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1192 microversion: 2.1 time: 0.210226 Oct 19 08:31:17.814770 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 521/1048] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:17 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1192 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:17.973682 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-354b712b-c72b-4aca-8207-4ed2243f15ab tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:17.974263 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-354b712b-c72b-4aca-8207-4ed2243f15ab tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:17.981301 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-354b712b-c72b-4aca-8207-4ed2243f15ab tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:17.989646 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-354b712b-c72b-4aca-8207-4ed2243f15ab tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:17.990519 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-354b712b-c72b-4aca-8207-4ed2243f15ab tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:17.990963 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-354b712b-c72b-4aca-8207-4ed2243f15ab tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:18.558559 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ee5c8b61-5300-43a4-91ed-b044829ad048 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:18.572686 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ee5c8b61-5300-43a4-91ed-b044829ad048 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1676 microversion: 2.1 time: 0.895306 Oct 19 08:31:18.575330 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 528/1049] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:17 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1676 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:31:18.721792 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-354b712b-c72b-4aca-8207-4ed2243f15ab tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:18.729831 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-354b712b-c72b-4aca-8207-4ed2243f15ab tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1260 microversion: 2.1 time: 0.760460 Oct 19 08:31:18.730404 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 522/1050] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:17 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1260 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:31:18.819532 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a76f9b59-9349-4b16-88de-baf9a9f860b7 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:18.820132 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a76f9b59-9349-4b16-88de-baf9a9f860b7 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:18.827093 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a76f9b59-9349-4b16-88de-baf9a9f860b7 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:18.827683 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a76f9b59-9349-4b16-88de-baf9a9f860b7 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:18.828301 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a76f9b59-9349-4b16-88de-baf9a9f860b7 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:18.828844 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a76f9b59-9349-4b16-88de-baf9a9f860b7 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:18.921170 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a76f9b59-9349-4b16-88de-baf9a9f860b7 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:18.932066 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a76f9b59-9349-4b16-88de-baf9a9f860b7 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1198 microversion: 2.1 time: 0.116062 Oct 19 08:31:18.932895 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 529/1051] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:18 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1198 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:19.275593 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-8988e815-caac-48cf-af71-e3e7a718aac3 req-849f3704-530d-45ba-8368-2effd20c5345 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59c3fb17-9b00-4111-afa2-59ce69f7a986", "tag": "12a0882c-425b-45ca-9a64-43ef73c77095"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:31:19.278066 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:31:19.278066 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:31:19.289108 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-8988e815-caac-48cf-af71-e3e7a718aac3 req-849f3704-530d-45ba-8368-2effd20c5345 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:19.292837 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-8988e815-caac-48cf-af71-e3e7a718aac3 req-849f3704-530d-45ba-8368-2effd20c5345 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:19.319758 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-8988e815-caac-48cf-af71-e3e7a718aac3 req-849f3704-530d-45ba-8368-2effd20c5345 service nova] Creating event network-changed:12a0882c-425b-45ca-9a64-43ef73c77095 for instance 59c3fb17-9b00-4111-afa2-59ce69f7a986 on hv-cinder-81398 Oct 19 08:31:19.333996 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-8988e815-caac-48cf-af71-e3e7a718aac3 req-849f3704-530d-45ba-8368-2effd20c5345 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.299139 Oct 19 08:31:19.335403 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 523/1052] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:31:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:31:19.592234 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-de9c3a44-3d4f-490d-9d9a-79036f7d6bd2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:19.593253 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-de9c3a44-3d4f-490d-9d9a-79036f7d6bd2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:19.601599 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-de9c3a44-3d4f-490d-9d9a-79036f7d6bd2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:19.602276 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-de9c3a44-3d4f-490d-9d9a-79036f7d6bd2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:19.603247 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-de9c3a44-3d4f-490d-9d9a-79036f7d6bd2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:19.608442 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-de9c3a44-3d4f-490d-9d9a-79036f7d6bd2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:19.747519 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2269d216-dc03-4c3a-8278-b0f49b2fe003 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:19.748416 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2269d216-dc03-4c3a-8278-b0f49b2fe003 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:19.760643 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2269d216-dc03-4c3a-8278-b0f49b2fe003 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:19.761350 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2269d216-dc03-4c3a-8278-b0f49b2fe003 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:19.762320 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2269d216-dc03-4c3a-8278-b0f49b2fe003 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:19.762930 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2269d216-dc03-4c3a-8278-b0f49b2fe003 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:20.440671 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-de9c3a44-3d4f-490d-9d9a-79036f7d6bd2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:20.462065 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-de9c3a44-3d4f-490d-9d9a-79036f7d6bd2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1676 microversion: 2.1 time: 0.867898 Oct 19 08:31:20.464050 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 530/1053] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:19 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1676 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:20.476299 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b170de0c-c976-4a86-b948-6bf3cb68bbb3 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:20.478197 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b170de0c-c976-4a86-b948-6bf3cb68bbb3 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:20.495294 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b170de0c-c976-4a86-b948-6bf3cb68bbb3 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:20.495740 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b170de0c-c976-4a86-b948-6bf3cb68bbb3 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:20.496526 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b170de0c-c976-4a86-b948-6bf3cb68bbb3 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:20.496954 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b170de0c-c976-4a86-b948-6bf3cb68bbb3 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:20.692925 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-2269d216-dc03-4c3a-8278-b0f49b2fe003 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:20.702039 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2269d216-dc03-4c3a-8278-b0f49b2fe003 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1260 microversion: 2.1 time: 0.958538 Oct 19 08:31:20.705922 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 524/1054] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:19 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1260 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:31:21.068216 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-b170de0c-c976-4a86-b948-6bf3cb68bbb3 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:21.077111 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b170de0c-c976-4a86-b948-6bf3cb68bbb3 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1265 microversion: 2.1 time: 0.611743 Oct 19 08:31:21.077693 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 531/1055] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:20 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1265 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:21.481014 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-b301423f-0b9e-4993-83c7-c3c5a073967d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:21.481655 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-b301423f-0b9e-4993-83c7-c3c5a073967d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:21.488077 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b301423f-0b9e-4993-83c7-c3c5a073967d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:21.488776 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b301423f-0b9e-4993-83c7-c3c5a073967d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:21.489713 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b301423f-0b9e-4993-83c7-c3c5a073967d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:21.490308 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b301423f-0b9e-4993-83c7-c3c5a073967d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:21.723632 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-de184363-bfb1-484a-a4d8-919537bee712 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:21.725160 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-de184363-bfb1-484a-a4d8-919537bee712 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:21.738158 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-de184363-bfb1-484a-a4d8-919537bee712 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:21.740977 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-de184363-bfb1-484a-a4d8-919537bee712 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:21.742184 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-de184363-bfb1-484a-a4d8-919537bee712 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:21.742828 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-de184363-bfb1-484a-a4d8-919537bee712 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:21.870993 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-b301423f-0b9e-4993-83c7-c3c5a073967d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:21.881707 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-b301423f-0b9e-4993-83c7-c3c5a073967d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1676 microversion: 2.1 time: 0.404307 Oct 19 08:31:21.894688 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 525/1056] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:21 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1676 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:22.098403 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-619b4154-712c-477d-83f4-77c7e7fe4c94 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:22.099286 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-619b4154-712c-477d-83f4-77c7e7fe4c94 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:22.107328 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-de184363-bfb1-484a-a4d8-919537bee712 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:22.115875 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-de184363-bfb1-484a-a4d8-919537bee712 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1260 microversion: 2.1 time: 0.396993 Oct 19 08:31:22.116063 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-619b4154-712c-477d-83f4-77c7e7fe4c94 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:22.116374 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-619b4154-712c-477d-83f4-77c7e7fe4c94 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:22.117333 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-619b4154-712c-477d-83f4-77c7e7fe4c94 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:22.118136 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-619b4154-712c-477d-83f4-77c7e7fe4c94 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:22.118479 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 532/1057] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:21 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1260 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:22.233477 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-b6baed6c-c0be-43fa-b548-4f83875da76b req-c25aec5d-6696-4279-94b8-75d0631e9717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9802a026-2641-4cdf-9d05-97a5272d6d8b", "tag": "ff26f079-abb3-425c-828c-e1118d527879"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:31:22.236758 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:31:22.236758 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:31:22.254737 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-b6baed6c-c0be-43fa-b548-4f83875da76b req-c25aec5d-6696-4279-94b8-75d0631e9717 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:22.255225 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-b6baed6c-c0be-43fa-b548-4f83875da76b req-c25aec5d-6696-4279-94b8-75d0631e9717 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:22.288720 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-b6baed6c-c0be-43fa-b548-4f83875da76b req-c25aec5d-6696-4279-94b8-75d0631e9717 service nova] Creating event network-changed:ff26f079-abb3-425c-828c-e1118d527879 for instance 9802a026-2641-4cdf-9d05-97a5272d6d8b on hv-cinder-81398 Oct 19 08:31:22.293570 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-b6baed6c-c0be-43fa-b548-4f83875da76b req-c25aec5d-6696-4279-94b8-75d0631e9717 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063744 Oct 19 08:31:22.294398 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 533/1058] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:31:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 08:31:22.435100 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-619b4154-712c-477d-83f4-77c7e7fe4c94 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:22.447426 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-619b4154-712c-477d-83f4-77c7e7fe4c94 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1265 microversion: 2.1 time: 0.352752 Oct 19 08:31:22.467590 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 526/1059] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:22 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1265 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:22.902035 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e88573d6-55bf-4884-abf5-2532c7f98a2f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:22.902764 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e88573d6-55bf-4884-abf5-2532c7f98a2f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:22.909661 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e88573d6-55bf-4884-abf5-2532c7f98a2f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:22.912361 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e88573d6-55bf-4884-abf5-2532c7f98a2f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:22.913716 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e88573d6-55bf-4884-abf5-2532c7f98a2f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:22.914376 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e88573d6-55bf-4884-abf5-2532c7f98a2f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:23.140363 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c1a3b57f-db45-442d-aeb3-a23e854ffc7c tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:23.142567 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-e88573d6-55bf-4884-abf5-2532c7f98a2f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:23.142834 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-c1a3b57f-db45-442d-aeb3-a23e854ffc7c tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:23.150930 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c1a3b57f-db45-442d-aeb3-a23e854ffc7c tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:23.152196 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c1a3b57f-db45-442d-aeb3-a23e854ffc7c tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:23.152599 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e88573d6-55bf-4884-abf5-2532c7f98a2f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1676 microversion: 2.1 time: 0.253286 Oct 19 08:31:23.153664 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c1a3b57f-db45-442d-aeb3-a23e854ffc7c tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:23.154562 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c1a3b57f-db45-442d-aeb3-a23e854ffc7c tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:23.162897 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 534/1060] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:22 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1676 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:23.464062 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-1e5413d6-b770-427b-a754-f1a5819f0807 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:23.464924 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-1e5413d6-b770-427b-a754-f1a5819f0807 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:23.475582 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1e5413d6-b770-427b-a754-f1a5819f0807 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:23.476290 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1e5413d6-b770-427b-a754-f1a5819f0807 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:23.477538 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1e5413d6-b770-427b-a754-f1a5819f0807 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:23.478118 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1e5413d6-b770-427b-a754-f1a5819f0807 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:23.648075 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-c1a3b57f-db45-442d-aeb3-a23e854ffc7c tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:23.658946 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-c1a3b57f-db45-442d-aeb3-a23e854ffc7c tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1260 microversion: 2.1 time: 0.526682 Oct 19 08:31:23.660196 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 527/1061] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:23 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1260 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:31:23.796458 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-1e5413d6-b770-427b-a754-f1a5819f0807 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:23.807414 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-1e5413d6-b770-427b-a754-f1a5819f0807 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1265 microversion: 2.1 time: 0.346931 Oct 19 08:31:23.812656 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 535/1062] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:23 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1265 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:31:24.170986 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-1ca6f7d4-c976-482e-8533-f50473ab2879 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:24.171591 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-1ca6f7d4-c976-482e-8533-f50473ab2879 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:24.178431 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1ca6f7d4-c976-482e-8533-f50473ab2879 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:24.179024 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1ca6f7d4-c976-482e-8533-f50473ab2879 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:24.179918 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1ca6f7d4-c976-482e-8533-f50473ab2879 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:24.180457 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1ca6f7d4-c976-482e-8533-f50473ab2879 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:24.313356 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-1ca6f7d4-c976-482e-8533-f50473ab2879 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:24.321208 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-1ca6f7d4-c976-482e-8533-f50473ab2879 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1676 microversion: 2.1 time: 0.154427 Oct 19 08:31:24.332313 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 528/1063] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:24 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:24.677483 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ce3a56e0-1b95-4115-80a4-984b8dc569f2 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:24.678447 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ce3a56e0-1b95-4115-80a4-984b8dc569f2 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:24.685039 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ce3a56e0-1b95-4115-80a4-984b8dc569f2 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:24.685489 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ce3a56e0-1b95-4115-80a4-984b8dc569f2 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:24.686286 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ce3a56e0-1b95-4115-80a4-984b8dc569f2 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:24.686748 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ce3a56e0-1b95-4115-80a4-984b8dc569f2 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:24.831314 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2baaa3b1-78c6-40ec-bb42-0505c281dc98 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:24.832312 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2baaa3b1-78c6-40ec-bb42-0505c281dc98 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:24.843781 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2baaa3b1-78c6-40ec-bb42-0505c281dc98 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:24.845439 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2baaa3b1-78c6-40ec-bb42-0505c281dc98 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:24.845675 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2baaa3b1-78c6-40ec-bb42-0505c281dc98 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:24.846116 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2baaa3b1-78c6-40ec-bb42-0505c281dc98 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:24.887104 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ce3a56e0-1b95-4115-80a4-984b8dc569f2 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:24.896511 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ce3a56e0-1b95-4115-80a4-984b8dc569f2 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1260 microversion: 2.1 time: 0.224031 Oct 19 08:31:24.906101 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 536/1064] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:24 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1260 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:25.096604 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-2baaa3b1-78c6-40ec-bb42-0505c281dc98 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:25.105321 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2baaa3b1-78c6-40ec-bb42-0505c281dc98 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1265 microversion: 2.1 time: 0.280245 Oct 19 08:31:25.106054 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 529/1065] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:24 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1265 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:25.339572 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b4a8cb98-16b0-4b79-aad0-1dd27013c1a4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:25.343090 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b4a8cb98-16b0-4b79-aad0-1dd27013c1a4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:25.352250 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b4a8cb98-16b0-4b79-aad0-1dd27013c1a4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:25.352664 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b4a8cb98-16b0-4b79-aad0-1dd27013c1a4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:25.353459 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b4a8cb98-16b0-4b79-aad0-1dd27013c1a4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:25.353887 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b4a8cb98-16b0-4b79-aad0-1dd27013c1a4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:25.512794 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-b4a8cb98-16b0-4b79-aad0-1dd27013c1a4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:25.520318 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b4a8cb98-16b0-4b79-aad0-1dd27013c1a4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1676 microversion: 2.1 time: 0.184702 Oct 19 08:31:25.525967 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 537/1066] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:25 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1676 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:25.913530 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-e28d57fd-ef69-40b4-a71e-82389deeb14f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:25.914116 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-e28d57fd-ef69-40b4-a71e-82389deeb14f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:25.920120 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e28d57fd-ef69-40b4-a71e-82389deeb14f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:25.921071 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e28d57fd-ef69-40b4-a71e-82389deeb14f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:25.921071 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e28d57fd-ef69-40b4-a71e-82389deeb14f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:25.923113 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e28d57fd-ef69-40b4-a71e-82389deeb14f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:26.059987 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-e28d57fd-ef69-40b4-a71e-82389deeb14f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:26.067999 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-e28d57fd-ef69-40b4-a71e-82389deeb14f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1260 microversion: 2.1 time: 0.158085 Oct 19 08:31:26.068871 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 530/1067] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:25 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:26.131088 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-f0383711-d2e2-4833-80e6-5f6bb931ff29 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:26.131702 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-f0383711-d2e2-4833-80e6-5f6bb931ff29 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:26.143345 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f0383711-d2e2-4833-80e6-5f6bb931ff29 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:26.143837 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f0383711-d2e2-4833-80e6-5f6bb931ff29 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:26.144666 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f0383711-d2e2-4833-80e6-5f6bb931ff29 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:26.145099 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f0383711-d2e2-4833-80e6-5f6bb931ff29 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:26.301452 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-f0383711-d2e2-4833-80e6-5f6bb931ff29 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:26.308990 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-f0383711-d2e2-4833-80e6-5f6bb931ff29 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1265 microversion: 2.1 time: 0.190377 Oct 19 08:31:26.309558 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 538/1068] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:26 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:26.537514 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d8388866-2a7a-4644-8230-1f602789b912 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:26.538315 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-d8388866-2a7a-4644-8230-1f602789b912 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:26.544616 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d8388866-2a7a-4644-8230-1f602789b912 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:26.545058 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d8388866-2a7a-4644-8230-1f602789b912 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:26.545813 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d8388866-2a7a-4644-8230-1f602789b912 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:26.546285 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d8388866-2a7a-4644-8230-1f602789b912 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:26.687362 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-d8388866-2a7a-4644-8230-1f602789b912 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:26.700935 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-d8388866-2a7a-4644-8230-1f602789b912 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1653 microversion: 2.1 time: 0.167068 Oct 19 08:31:26.713276 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 531/1069] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:26 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1653 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:26.718103 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-1b5f850c-d49c-4519-b040-7ec3d6a2ff9e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:31:26.725301 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1b5f850c-d49c-4519-b040-7ec3d6a2ff9e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:26.725752 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1b5f850c-d49c-4519-b040-7ec3d6a2ff9e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:26.749927 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-1b5f850c-d49c-4519-b040-7ec3d6a2ff9e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Going to try to start instance {{(pid=114106) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 19 08:31:26.799543 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-1b5f850c-d49c-4519-b040-7ec3d6a2ff9e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action" status: 202 len: 0 microversion: 2.1 time: 0.084692 Oct 19 08:31:26.807926 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-5a011433-d351-4151-ab89-67128b42af9b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:26.808915 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-5a011433-d351-4151-ab89-67128b42af9b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:26.815618 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5a011433-d351-4151-ab89-67128b42af9b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:26.816088 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5a011433-d351-4151-ab89-67128b42af9b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:26.817063 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5a011433-d351-4151-ab89-67128b42af9b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:26.817641 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5a011433-d351-4151-ab89-67128b42af9b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:26.818541 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 539/1070] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:31:26 2021] POST /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:31:26.984478 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-5a011433-d351-4151-ab89-67128b42af9b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:26.993708 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-5a011433-d351-4151-ab89-67128b42af9b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1662 microversion: 2.1 time: 0.189312 Oct 19 08:31:26.998681 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 532/1071] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:26 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1662 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:31:27.085545 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-d0932d50-7765-4b12-b80f-c432502d6a74 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:27.086404 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-d0932d50-7765-4b12-b80f-c432502d6a74 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:27.092894 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d0932d50-7765-4b12-b80f-c432502d6a74 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:27.093468 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d0932d50-7765-4b12-b80f-c432502d6a74 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:27.095303 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d0932d50-7765-4b12-b80f-c432502d6a74 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:27.095741 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d0932d50-7765-4b12-b80f-c432502d6a74 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:27.306398 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-d0932d50-7765-4b12-b80f-c432502d6a74 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:27.315997 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-d0932d50-7765-4b12-b80f-c432502d6a74 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1260 microversion: 2.1 time: 0.234565 Oct 19 08:31:27.325417 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 540/1072] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:27 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1260 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:27.326867 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-5c1b7b70-5980-447c-92ba-d4c86337253d tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:27.330144 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-5c1b7b70-5980-447c-92ba-d4c86337253d tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:27.335158 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5c1b7b70-5980-447c-92ba-d4c86337253d tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:27.335753 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5c1b7b70-5980-447c-92ba-d4c86337253d tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:27.336706 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5c1b7b70-5980-447c-92ba-d4c86337253d tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:27.337245 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5c1b7b70-5980-447c-92ba-d4c86337253d tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:27.625593 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-5c1b7b70-5980-447c-92ba-d4c86337253d tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:27.633754 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-5c1b7b70-5980-447c-92ba-d4c86337253d tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1265 microversion: 2.1 time: 0.310759 Oct 19 08:31:27.634449 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 533/1073] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:27 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1265 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:28.012167 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-5173787c-1470-4daa-8a61-59e6f87958a1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:28.012984 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-5173787c-1470-4daa-8a61-59e6f87958a1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:28.019168 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5173787c-1470-4daa-8a61-59e6f87958a1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:28.019698 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5173787c-1470-4daa-8a61-59e6f87958a1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:28.020545 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5173787c-1470-4daa-8a61-59e6f87958a1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:28.021063 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5173787c-1470-4daa-8a61-59e6f87958a1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:28.150831 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-5173787c-1470-4daa-8a61-59e6f87958a1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:28.159522 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-5173787c-1470-4daa-8a61-59e6f87958a1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1662 microversion: 2.1 time: 0.151338 Oct 19 08:31:28.160089 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 541/1074] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:28 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1662 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:28.190136 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2d1ce4c8-ba2a-4b58-a28b-3e1b43b2f28a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Action: 'create', calling method: .version_select at 0x7fcadf7bbaf0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1588346439"}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:31:28.208972 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-2d1ce4c8-ba2a-4b58-a28b-3e1b43b2f28a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Getting quotas for project cd22145dede44acfb6409d55f4c00fcd. Resources: {'key_pairs'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:31:28.212927 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-2d1ce4c8-ba2a-4b58-a28b-3e1b43b2f28a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Getting quotas for user d530762e3bbd4a2cad4a0002c7d52a48 and project cd22145dede44acfb6409d55f4c00fcd. Resources: {'key_pairs'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:31:28.333557 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-da4ab20e-8e7e-47ec-a53a-f76b4724d8a9 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:28.334295 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-da4ab20e-8e7e-47ec-a53a-f76b4724d8a9 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:28.340040 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-da4ab20e-8e7e-47ec-a53a-f76b4724d8a9 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:28.340482 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-da4ab20e-8e7e-47ec-a53a-f76b4724d8a9 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:28.341237 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-da4ab20e-8e7e-47ec-a53a-f76b4724d8a9 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:28.341665 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-da4ab20e-8e7e-47ec-a53a-f76b4724d8a9 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:28.423358 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-2d1ce4c8-ba2a-4b58-a28b-3e1b43b2f28a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Getting quotas for project cd22145dede44acfb6409d55f4c00fcd. Resources: {'key_pairs'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:31:28.427013 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-2d1ce4c8-ba2a-4b58-a28b-3e1b43b2f28a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Getting quotas for user d530762e3bbd4a2cad4a0002c7d52a48 and project cd22145dede44acfb6409d55f4c00fcd. Resources: {'key_pairs'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:31:28.440311 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2d1ce4c8-ba2a-4b58-a28b-3e1b43b2f28a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.254508 Oct 19 08:31:28.440827 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 534/1075] 10.222.0.26 () {60 vars in 1157 bytes} [Tue Oct 19 08:31:28 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:28.466472 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-da4ab20e-8e7e-47ec-a53a-f76b4724d8a9 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:28.474402 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-da4ab20e-8e7e-47ec-a53a-f76b4724d8a9 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1260 microversion: 2.1 time: 0.144557 Oct 19 08:31:28.475078 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 542/1076] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:28 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1260 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:31:28.489041 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-03a2db81-1749-4b5a-8499-1146953ce76e tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-515435902", "imageRef": "1595ea94-5ed5-478f-919b-0da7a93ffc09", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1588346439", "networks": [{"uuid": "dee2382b-c3c0-47d6-b386-cc27151b1833"}]}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:31:28.538279 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.network.neutron [None req-03a2db81-1749-4b5a-8499-1146953ce76e tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] validate_networks() for [('dee2382b-c3c0-47d6-b386-cc27151b1833', None, None, None, None, None)] {{(pid=114105) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 19 08:31:28.631575 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: ERROR oslo.messaging._drivers.impl_rabbit [-] [94e1973e-8f05-4377-b6ab-aea34b007747] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 08:31:28.650804 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ffe10b2f-a7cf-45c2-bb6e-2431662aa431 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:28.651505 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ffe10b2f-a7cf-45c2-bb6e-2431662aa431 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:28.657807 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ffe10b2f-a7cf-45c2-bb6e-2431662aa431 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:28.658242 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ffe10b2f-a7cf-45c2-bb6e-2431662aa431 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:28.659021 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ffe10b2f-a7cf-45c2-bb6e-2431662aa431 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:28.659438 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ffe10b2f-a7cf-45c2-bb6e-2431662aa431 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:28.716818 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9a5a4159-6059-411d-8c9e-019f3fe5d8cf] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 08:31:28.842724 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ffe10b2f-a7cf-45c2-bb6e-2431662aa431 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:28.850343 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ffe10b2f-a7cf-45c2-bb6e-2431662aa431 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1265 microversion: 2.1 time: 0.203063 Oct 19 08:31:28.850942 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 543/1077] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:28 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:31:28.957302 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-03a2db81-1749-4b5a-8499-1146953ce76e tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Flavor limits 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 08:31:28.957710 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-03a2db81-1749-4b5a-8499-1146953ce76e tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Image limits 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 08:31:28.958172 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-03a2db81-1749-4b5a-8499-1146953ce76e tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Flavor pref 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 08:31:28.958616 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-03a2db81-1749-4b5a-8499-1146953ce76e tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Image pref 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 08:31:28.959361 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-03a2db81-1749-4b5a-8499-1146953ce76e tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 08:31:28.968072 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-03a2db81-1749-4b5a-8499-1146953ce76e tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:28.968444 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-03a2db81-1749-4b5a-8499-1146953ce76e tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:28.969818 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-03a2db81-1749-4b5a-8499-1146953ce76e tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:28.970247 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-03a2db81-1749-4b5a-8499-1146953ce76e tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:28.985797 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-03a2db81-1749-4b5a-8499-1146953ce76e tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Getting quotas for project cd22145dede44acfb6409d55f4c00fcd. Resources: {'cores', 'instances', 'ram'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:31:28.989579 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-03a2db81-1749-4b5a-8499-1146953ce76e tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Getting quotas for user d530762e3bbd4a2cad4a0002c7d52a48 and project cd22145dede44acfb6409d55f4c00fcd. Resources: {'cores', 'instances', 'ram'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:31:28.999743 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-03a2db81-1749-4b5a-8499-1146953ce76e tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Going to run 1 instances... {{(pid=114105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 19 08:31:29.002143 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-03a2db81-1749-4b5a-8499-1146953ce76e tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1595ea94-5ed5-478f-919b-0da7a93ffc09',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 19 08:31:29.045882 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-03a2db81-1749-4b5a-8499-1146953ce76e tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.561187 Oct 19 08:31:29.046540 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 535/1078] 10.222.0.26 () {60 vars in 1146 bytes} [Tue Oct 19 08:31:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 08:31:29.056149 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e03df715-6352-447c-8a8c-f21f94c4d231 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:29.056752 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e03df715-6352-447c-8a8c-f21f94c4d231 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:29.108196 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-e03df715-6352-447c-8a8c-f21f94c4d231 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:29.114478 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e03df715-6352-447c-8a8c-f21f94c4d231 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1258 microversion: 2.1 time: 0.061898 Oct 19 08:31:29.115073 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 544/1079] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:29 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1258 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:31:29.176866 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-3c61c9af-44ce-46c6-9ce1-22065a2af369 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:29.177471 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-3c61c9af-44ce-46c6-9ce1-22065a2af369 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:29.183546 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3c61c9af-44ce-46c6-9ce1-22065a2af369 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:29.183985 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3c61c9af-44ce-46c6-9ce1-22065a2af369 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:29.184745 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3c61c9af-44ce-46c6-9ce1-22065a2af369 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:29.185169 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3c61c9af-44ce-46c6-9ce1-22065a2af369 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:29.317586 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-3c61c9af-44ce-46c6-9ce1-22065a2af369 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:29.325060 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-3c61c9af-44ce-46c6-9ce1-22065a2af369 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1666 microversion: 2.1 time: 0.151781 Oct 19 08:31:29.325749 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 536/1080] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:29 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1666 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:29.490942 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-387078d6-eed4-48e1-91c7-c519e90f63fd tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:29.491545 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-387078d6-eed4-48e1-91c7-c519e90f63fd tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:29.498672 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-387078d6-eed4-48e1-91c7-c519e90f63fd tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:29.499124 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-387078d6-eed4-48e1-91c7-c519e90f63fd tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:29.499951 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-387078d6-eed4-48e1-91c7-c519e90f63fd tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:29.500328 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-387078d6-eed4-48e1-91c7-c519e90f63fd tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:29.629692 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-387078d6-eed4-48e1-91c7-c519e90f63fd tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:29.637393 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-387078d6-eed4-48e1-91c7-c519e90f63fd tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1260 microversion: 2.1 time: 0.150087 Oct 19 08:31:29.637956 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 545/1081] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:29 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:29.667096 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-512ad4e8-5123-4ea3-a26c-7c17cd67d84b req-3f18126a-22ff-4b77-b7a3-000ffecf5d6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59c3fb17-9b00-4111-afa2-59ce69f7a986", "name": "network-vif-plugged", "status": "completed", "tag": "12a0882c-425b-45ca-9a64-43ef73c77095"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:31:29.668674 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:31:29.668674 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:31:29.686669 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-512ad4e8-5123-4ea3-a26c-7c17cd67d84b req-3f18126a-22ff-4b77-b7a3-000ffecf5d6c service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:29.687107 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-512ad4e8-5123-4ea3-a26c-7c17cd67d84b req-3f18126a-22ff-4b77-b7a3-000ffecf5d6c service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:29.699226 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-512ad4e8-5123-4ea3-a26c-7c17cd67d84b req-3f18126a-22ff-4b77-b7a3-000ffecf5d6c service nova] Creating event network-vif-plugged:12a0882c-425b-45ca-9a64-43ef73c77095 for instance 59c3fb17-9b00-4111-afa2-59ce69f7a986 on hv-cinder-81398 Oct 19 08:31:29.702672 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO oslo.messaging._drivers.impl_rabbit [-] [94e1973e-8f05-4377-b6ab-aea34b007747] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 56442. Oct 19 08:31:29.704389 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-512ad4e8-5123-4ea3-a26c-7c17cd67d84b req-3f18126a-22ff-4b77-b7a3-000ffecf5d6c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040917 Oct 19 08:31:29.704997 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 537/1082] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:31:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:31:29.866790 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-05ca2361-4a38-4f6e-b7d3-e26b379011b7 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:29.867389 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-05ca2361-4a38-4f6e-b7d3-e26b379011b7 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:29.887185 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO oslo.messaging._drivers.impl_rabbit [-] [9a5a4159-6059-411d-8c9e-019f3fe5d8cf] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 56446. Oct 19 08:31:29.893703 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-05ca2361-4a38-4f6e-b7d3-e26b379011b7 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:29.894146 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-05ca2361-4a38-4f6e-b7d3-e26b379011b7 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:29.894946 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-05ca2361-4a38-4f6e-b7d3-e26b379011b7 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:29.895371 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-05ca2361-4a38-4f6e-b7d3-e26b379011b7 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:30.092006 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-05ca2361-4a38-4f6e-b7d3-e26b379011b7 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:30.100621 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-05ca2361-4a38-4f6e-b7d3-e26b379011b7 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1265 microversion: 2.1 time: 0.237416 Oct 19 08:31:30.101577 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 546/1083] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:29 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:30.132352 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-adf0f3b3-0c6d-4d41-a92c-44c1f1c70832 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:30.132964 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-adf0f3b3-0c6d-4d41-a92c-44c1f1c70832 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:30.139180 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-adf0f3b3-0c6d-4d41-a92c-44c1f1c70832 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:30.139683 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-adf0f3b3-0c6d-4d41-a92c-44c1f1c70832 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:30.140449 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-adf0f3b3-0c6d-4d41-a92c-44c1f1c70832 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:30.140882 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-adf0f3b3-0c6d-4d41-a92c-44c1f1c70832 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:30.200296 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-adf0f3b3-0c6d-4d41-a92c-44c1f1c70832 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:30.207818 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-adf0f3b3-0c6d-4d41-a92c-44c1f1c70832 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1328 microversion: 2.1 time: 0.079826 Oct 19 08:31:30.208384 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 538/1084] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:30 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1328 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:30.654696 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-fb261082-419d-40c2-b98e-3704c3e39312 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:30.655299 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-fb261082-419d-40c2-b98e-3704c3e39312 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:30.670116 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fb261082-419d-40c2-b98e-3704c3e39312 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:30.671073 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fb261082-419d-40c2-b98e-3704c3e39312 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:30.672956 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fb261082-419d-40c2-b98e-3704c3e39312 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:30.673842 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fb261082-419d-40c2-b98e-3704c3e39312 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:30.854753 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-fb261082-419d-40c2-b98e-3704c3e39312 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:30.865026 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-fb261082-419d-40c2-b98e-3704c3e39312 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1260 microversion: 2.1 time: 0.213993 Oct 19 08:31:30.873804 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 547/1085] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:30 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1260 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:31.117048 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-a03ed6c0-28c1-4693-8c3a-eb44621a1bcc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:31.117766 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-a03ed6c0-28c1-4693-8c3a-eb44621a1bcc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:31.125227 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a03ed6c0-28c1-4693-8c3a-eb44621a1bcc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:31.125815 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a03ed6c0-28c1-4693-8c3a-eb44621a1bcc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:31.126660 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a03ed6c0-28c1-4693-8c3a-eb44621a1bcc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:31.127157 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a03ed6c0-28c1-4693-8c3a-eb44621a1bcc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:31.225489 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-bc680379-c7ec-49d4-bd44-ac6931083d40 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:31.226291 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-bc680379-c7ec-49d4-bd44-ac6931083d40 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:31.232130 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bc680379-c7ec-49d4-bd44-ac6931083d40 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:31.232576 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bc680379-c7ec-49d4-bd44-ac6931083d40 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:31.233336 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bc680379-c7ec-49d4-bd44-ac6931083d40 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:31.233788 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bc680379-c7ec-49d4-bd44-ac6931083d40 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:31.273824 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-a03ed6c0-28c1-4693-8c3a-eb44621a1bcc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:31.283051 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-a03ed6c0-28c1-4693-8c3a-eb44621a1bcc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1265 microversion: 2.1 time: 0.168797 Oct 19 08:31:31.284299 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 539/1086] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:31 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:31.367330 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-bc680379-c7ec-49d4-bd44-ac6931083d40 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:31.375923 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-bc680379-c7ec-49d4-bd44-ac6931083d40 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1358 microversion: 2.1 time: 0.153812 Oct 19 08:31:31.376693 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 548/1087] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:31 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:31:31.889840 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-68519891-7dfc-43ab-a4ca-602af8f933f7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:31.890435 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-68519891-7dfc-43ab-a4ca-602af8f933f7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:31.896979 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-68519891-7dfc-43ab-a4ca-602af8f933f7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:31.897420 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-68519891-7dfc-43ab-a4ca-602af8f933f7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:31.898333 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-68519891-7dfc-43ab-a4ca-602af8f933f7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:31.898617 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-68519891-7dfc-43ab-a4ca-602af8f933f7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:32.026458 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-68519891-7dfc-43ab-a4ca-602af8f933f7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:32.034375 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-68519891-7dfc-43ab-a4ca-602af8f933f7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1260 microversion: 2.1 time: 0.148106 Oct 19 08:31:32.034963 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 540/1088] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:31 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:32.300723 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-6d0646fa-60ca-471d-a857-52be7177ea56 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:32.301328 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-6d0646fa-60ca-471d-a857-52be7177ea56 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:32.307388 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6d0646fa-60ca-471d-a857-52be7177ea56 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:32.308035 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6d0646fa-60ca-471d-a857-52be7177ea56 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:32.308968 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6d0646fa-60ca-471d-a857-52be7177ea56 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:32.309586 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6d0646fa-60ca-471d-a857-52be7177ea56 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:32.393511 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-55f55868-f4df-4e63-9aeb-1338e1e5c636 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:32.394118 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-55f55868-f4df-4e63-9aeb-1338e1e5c636 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:32.406356 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-55f55868-f4df-4e63-9aeb-1338e1e5c636 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:32.407506 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-55f55868-f4df-4e63-9aeb-1338e1e5c636 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:32.408296 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-55f55868-f4df-4e63-9aeb-1338e1e5c636 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:32.408726 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-55f55868-f4df-4e63-9aeb-1338e1e5c636 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:32.445013 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-6d0646fa-60ca-471d-a857-52be7177ea56 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:32.452284 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-6d0646fa-60ca-471d-a857-52be7177ea56 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1265 microversion: 2.1 time: 0.155498 Oct 19 08:31:32.452854 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 549/1089] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:32 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:31:32.536791 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-55f55868-f4df-4e63-9aeb-1338e1e5c636 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:32.544110 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-55f55868-f4df-4e63-9aeb-1338e1e5c636 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1358 microversion: 2.1 time: 0.154713 Oct 19 08:31:32.544697 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 541/1090] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:32 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:33.051202 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-fd974f2e-e0bd-415a-b7cf-fe2b49f533ec tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:33.051920 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-fd974f2e-e0bd-415a-b7cf-fe2b49f533ec tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:33.057912 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fd974f2e-e0bd-415a-b7cf-fe2b49f533ec tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:33.058353 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fd974f2e-e0bd-415a-b7cf-fe2b49f533ec tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:33.059148 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fd974f2e-e0bd-415a-b7cf-fe2b49f533ec tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:33.059573 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fd974f2e-e0bd-415a-b7cf-fe2b49f533ec tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:33.182822 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-fd974f2e-e0bd-415a-b7cf-fe2b49f533ec tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:33.190949 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-fd974f2e-e0bd-415a-b7cf-fe2b49f533ec tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1260 microversion: 2.1 time: 0.143389 Oct 19 08:31:33.191714 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 550/1091] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:33 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1260 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:33.468937 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-3cea727b-3be0-4a7f-8565-7cbcd32624eb tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:33.469793 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-3cea727b-3be0-4a7f-8565-7cbcd32624eb tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:33.476587 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3cea727b-3be0-4a7f-8565-7cbcd32624eb tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:33.477219 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3cea727b-3be0-4a7f-8565-7cbcd32624eb tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:33.478324 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3cea727b-3be0-4a7f-8565-7cbcd32624eb tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:33.478887 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3cea727b-3be0-4a7f-8565-7cbcd32624eb tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:33.561491 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-be3184cf-5e53-409e-b142-8ab75f1deacf tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:33.562232 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-be3184cf-5e53-409e-b142-8ab75f1deacf tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:33.569426 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-be3184cf-5e53-409e-b142-8ab75f1deacf tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:33.569905 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-be3184cf-5e53-409e-b142-8ab75f1deacf tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:33.570923 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-be3184cf-5e53-409e-b142-8ab75f1deacf tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:33.571574 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-be3184cf-5e53-409e-b142-8ab75f1deacf tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:33.614556 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-3cea727b-3be0-4a7f-8565-7cbcd32624eb tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:33.623266 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-3cea727b-3be0-4a7f-8565-7cbcd32624eb tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1265 microversion: 2.1 time: 0.157751 Oct 19 08:31:33.624414 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 542/1092] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:33 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:33.721846 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-be3184cf-5e53-409e-b142-8ab75f1deacf tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:33.729861 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-be3184cf-5e53-409e-b142-8ab75f1deacf tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1358 microversion: 2.1 time: 0.172041 Oct 19 08:31:33.731976 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-b6822137-1fb2-4f47-a985-242e9c30ca06 req-a584f0c6-8904-4e39-80fe-bed1bd257782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9802a026-2641-4cdf-9d05-97a5272d6d8b", "name": "network-vif-plugged", "status": "completed", "tag": "ff26f079-abb3-425c-828c-e1118d527879"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:31:33.734264 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:31:33.734264 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:31:33.739135 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 551/1093] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:33 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:31:33.742045 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-b6822137-1fb2-4f47-a985-242e9c30ca06 req-a584f0c6-8904-4e39-80fe-bed1bd257782 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:33.742474 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-b6822137-1fb2-4f47-a985-242e9c30ca06 req-a584f0c6-8904-4e39-80fe-bed1bd257782 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:33.754087 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-b6822137-1fb2-4f47-a985-242e9c30ca06 req-a584f0c6-8904-4e39-80fe-bed1bd257782 service nova] Creating event network-vif-plugged:ff26f079-abb3-425c-828c-e1118d527879 for instance 9802a026-2641-4cdf-9d05-97a5272d6d8b on hv-cinder-81398 Oct 19 08:31:33.758725 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-b6822137-1fb2-4f47-a985-242e9c30ca06 req-a584f0c6-8904-4e39-80fe-bed1bd257782 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030843 Oct 19 08:31:33.759299 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 543/1094] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:31:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 08:31:34.207937 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-019c74ff-65ca-4a54-bc5b-73cb6d103cfc tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:34.208522 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-019c74ff-65ca-4a54-bc5b-73cb6d103cfc tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:34.214424 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-019c74ff-65ca-4a54-bc5b-73cb6d103cfc tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:34.214892 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-019c74ff-65ca-4a54-bc5b-73cb6d103cfc tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:34.215656 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-019c74ff-65ca-4a54-bc5b-73cb6d103cfc tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:34.216080 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-019c74ff-65ca-4a54-bc5b-73cb6d103cfc tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:34.338695 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-019c74ff-65ca-4a54-bc5b-73cb6d103cfc tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:34.347269 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-019c74ff-65ca-4a54-bc5b-73cb6d103cfc tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1260 microversion: 2.1 time: 0.142925 Oct 19 08:31:34.352611 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 552/1095] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:34 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:34.640728 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-202b45a2-e69b-4634-a299-707b81e90d62 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:34.641419 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-202b45a2-e69b-4634-a299-707b81e90d62 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:34.647762 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-202b45a2-e69b-4634-a299-707b81e90d62 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:34.648201 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-202b45a2-e69b-4634-a299-707b81e90d62 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:34.648971 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-202b45a2-e69b-4634-a299-707b81e90d62 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:34.649396 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-202b45a2-e69b-4634-a299-707b81e90d62 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:34.746413 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3a1a3346-35db-47b2-ab9c-7ae869546c31 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:34.747055 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3a1a3346-35db-47b2-ab9c-7ae869546c31 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:34.755669 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3a1a3346-35db-47b2-ab9c-7ae869546c31 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:34.756446 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3a1a3346-35db-47b2-ab9c-7ae869546c31 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:34.757379 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3a1a3346-35db-47b2-ab9c-7ae869546c31 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:34.758050 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3a1a3346-35db-47b2-ab9c-7ae869546c31 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:34.779613 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-202b45a2-e69b-4634-a299-707b81e90d62 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:34.786767 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-202b45a2-e69b-4634-a299-707b81e90d62 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1265 microversion: 2.1 time: 0.150066 Oct 19 08:31:34.787317 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 544/1096] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:34 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:34.880783 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3a1a3346-35db-47b2-ab9c-7ae869546c31 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:34.888278 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3a1a3346-35db-47b2-ab9c-7ae869546c31 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1358 microversion: 2.1 time: 0.145382 Oct 19 08:31:34.888841 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 553/1097] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:34 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:35.367439 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-41c4b3a4-8ed2-487b-810d-a1fefedfb3d4 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:35.369685 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-41c4b3a4-8ed2-487b-810d-a1fefedfb3d4 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:35.377583 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-41c4b3a4-8ed2-487b-810d-a1fefedfb3d4 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:35.377829 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-41c4b3a4-8ed2-487b-810d-a1fefedfb3d4 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:35.378623 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-41c4b3a4-8ed2-487b-810d-a1fefedfb3d4 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:35.379048 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-41c4b3a4-8ed2-487b-810d-a1fefedfb3d4 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:35.513697 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-41c4b3a4-8ed2-487b-810d-a1fefedfb3d4 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:35.521044 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-41c4b3a4-8ed2-487b-810d-a1fefedfb3d4 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1260 microversion: 2.1 time: 0.159380 Oct 19 08:31:35.521597 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 545/1098] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:35 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:35.804022 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-734327c0-5f69-4f44-b3d5-065eb5e08a35 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:35.804620 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-734327c0-5f69-4f44-b3d5-065eb5e08a35 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:35.811077 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-734327c0-5f69-4f44-b3d5-065eb5e08a35 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:35.811894 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-734327c0-5f69-4f44-b3d5-065eb5e08a35 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:35.813518 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-734327c0-5f69-4f44-b3d5-065eb5e08a35 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:35.814262 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-734327c0-5f69-4f44-b3d5-065eb5e08a35 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:35.904705 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-75f769b8-0d6b-4346-a1b0-f3392227b73a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:35.905302 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-75f769b8-0d6b-4346-a1b0-f3392227b73a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:35.912021 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-75f769b8-0d6b-4346-a1b0-f3392227b73a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:35.912462 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-75f769b8-0d6b-4346-a1b0-f3392227b73a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:35.913221 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-75f769b8-0d6b-4346-a1b0-f3392227b73a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:35.913643 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-75f769b8-0d6b-4346-a1b0-f3392227b73a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:35.956364 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-734327c0-5f69-4f44-b3d5-065eb5e08a35 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:35.965774 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-734327c0-5f69-4f44-b3d5-065eb5e08a35 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1265 microversion: 2.1 time: 0.165480 Oct 19 08:31:35.966558 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 554/1099] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:35 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:36.070923 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-75f769b8-0d6b-4346-a1b0-f3392227b73a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:36.077999 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-75f769b8-0d6b-4346-a1b0-f3392227b73a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1358 microversion: 2.1 time: 0.176837 Oct 19 08:31:36.078603 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 546/1100] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:35 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:36.538690 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-8b6fc6d5-71a0-41b7-9940-700311cd8e53 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:36.539294 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-8b6fc6d5-71a0-41b7-9940-700311cd8e53 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:36.545121 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8b6fc6d5-71a0-41b7-9940-700311cd8e53 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:36.545554 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8b6fc6d5-71a0-41b7-9940-700311cd8e53 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:36.546305 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8b6fc6d5-71a0-41b7-9940-700311cd8e53 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:36.546748 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8b6fc6d5-71a0-41b7-9940-700311cd8e53 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:36.671852 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-8b6fc6d5-71a0-41b7-9940-700311cd8e53 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:36.680064 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-8b6fc6d5-71a0-41b7-9940-700311cd8e53 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1260 microversion: 2.1 time: 0.144936 Oct 19 08:31:36.688579 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 555/1101] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:36 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:36.985417 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-631ca6e8-a021-4702-b9fd-e017784e1b33 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:36.986143 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-631ca6e8-a021-4702-b9fd-e017784e1b33 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:36.991980 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-631ca6e8-a021-4702-b9fd-e017784e1b33 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:36.992504 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-631ca6e8-a021-4702-b9fd-e017784e1b33 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:36.993418 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-631ca6e8-a021-4702-b9fd-e017784e1b33 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:36.993843 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-631ca6e8-a021-4702-b9fd-e017784e1b33 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:37.095710 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-769158f7-c62a-4a3d-8790-a6449f737aab tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:37.096561 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-769158f7-c62a-4a3d-8790-a6449f737aab tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:37.104295 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-769158f7-c62a-4a3d-8790-a6449f737aab tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:37.104738 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-769158f7-c62a-4a3d-8790-a6449f737aab tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:37.105507 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-769158f7-c62a-4a3d-8790-a6449f737aab tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:37.105931 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-769158f7-c62a-4a3d-8790-a6449f737aab tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:37.134289 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-631ca6e8-a021-4702-b9fd-e017784e1b33 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:37.142499 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-631ca6e8-a021-4702-b9fd-e017784e1b33 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1265 microversion: 2.1 time: 0.161507 Oct 19 08:31:37.143069 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 547/1102] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:36 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:37.226340 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-769158f7-c62a-4a3d-8790-a6449f737aab tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:37.233375 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-769158f7-c62a-4a3d-8790-a6449f737aab tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1358 microversion: 2.1 time: 0.142291 Oct 19 08:31:37.233922 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 556/1103] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:37 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1358 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:31:37.696602 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-09d117fe-f65c-4280-944b-c7102e1c272f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:37.697201 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-09d117fe-f65c-4280-944b-c7102e1c272f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:37.704115 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-09d117fe-f65c-4280-944b-c7102e1c272f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:37.704660 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-09d117fe-f65c-4280-944b-c7102e1c272f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:37.705426 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-09d117fe-f65c-4280-944b-c7102e1c272f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:37.705849 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-09d117fe-f65c-4280-944b-c7102e1c272f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:37.860941 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-09d117fe-f65c-4280-944b-c7102e1c272f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:37.868306 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-09d117fe-f65c-4280-944b-c7102e1c272f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1260 microversion: 2.1 time: 0.175411 Oct 19 08:31:37.868908 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 548/1104] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:37 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:38.166289 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b2f2a3a9-d50e-42bf-9661-3be687436bfc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:38.167194 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b2f2a3a9-d50e-42bf-9661-3be687436bfc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:38.173804 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b2f2a3a9-d50e-42bf-9661-3be687436bfc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:38.174238 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b2f2a3a9-d50e-42bf-9661-3be687436bfc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:38.175031 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b2f2a3a9-d50e-42bf-9661-3be687436bfc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:38.175461 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b2f2a3a9-d50e-42bf-9661-3be687436bfc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:38.253204 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-673d2524-1acf-4e91-b9c7-cafe642a0b5d tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:38.253830 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-673d2524-1acf-4e91-b9c7-cafe642a0b5d tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:38.259690 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-673d2524-1acf-4e91-b9c7-cafe642a0b5d tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:38.260408 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-673d2524-1acf-4e91-b9c7-cafe642a0b5d tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:38.261429 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-673d2524-1acf-4e91-b9c7-cafe642a0b5d tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:38.261853 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-673d2524-1acf-4e91-b9c7-cafe642a0b5d tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:38.334961 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-b2f2a3a9-d50e-42bf-9661-3be687436bfc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:38.342832 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b2f2a3a9-d50e-42bf-9661-3be687436bfc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1265 microversion: 2.1 time: 0.180126 Oct 19 08:31:38.343430 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 557/1105] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:38 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:38.398790 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-673d2524-1acf-4e91-b9c7-cafe642a0b5d tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:38.405884 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-673d2524-1acf-4e91-b9c7-cafe642a0b5d tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1358 microversion: 2.1 time: 0.156685 Oct 19 08:31:38.406437 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 549/1106] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:38 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:38.884968 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-0c226973-b563-44f4-af69-2cc885e94631 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:38.885937 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-0c226973-b563-44f4-af69-2cc885e94631 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:38.892472 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0c226973-b563-44f4-af69-2cc885e94631 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:38.892919 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0c226973-b563-44f4-af69-2cc885e94631 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:38.893766 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0c226973-b563-44f4-af69-2cc885e94631 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:38.894163 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0c226973-b563-44f4-af69-2cc885e94631 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:39.020484 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-0c226973-b563-44f4-af69-2cc885e94631 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:39.028241 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-0c226973-b563-44f4-af69-2cc885e94631 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1260 microversion: 2.1 time: 0.147001 Oct 19 08:31:39.028807 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 558/1107] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:38 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:39.359152 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-289d6fe2-e9a3-4668-a56d-71464039033c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:39.360814 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-289d6fe2-e9a3-4668-a56d-71464039033c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:39.366589 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-289d6fe2-e9a3-4668-a56d-71464039033c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:39.367132 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-289d6fe2-e9a3-4668-a56d-71464039033c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:39.368088 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-289d6fe2-e9a3-4668-a56d-71464039033c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:39.368537 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-289d6fe2-e9a3-4668-a56d-71464039033c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:39.423556 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-d680dc55-9fb4-4c58-bbdc-4b28685c6d41 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:39.424379 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-d680dc55-9fb4-4c58-bbdc-4b28685c6d41 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:39.430124 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d680dc55-9fb4-4c58-bbdc-4b28685c6d41 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:39.430591 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d680dc55-9fb4-4c58-bbdc-4b28685c6d41 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:39.431341 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d680dc55-9fb4-4c58-bbdc-4b28685c6d41 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:39.431758 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d680dc55-9fb4-4c58-bbdc-4b28685c6d41 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:39.530050 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-289d6fe2-e9a3-4668-a56d-71464039033c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:39.538544 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-289d6fe2-e9a3-4668-a56d-71464039033c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1265 microversion: 2.1 time: 0.182907 Oct 19 08:31:39.539215 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 550/1108] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:39 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:39.585982 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-d680dc55-9fb4-4c58-bbdc-4b28685c6d41 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:39.593266 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-d680dc55-9fb4-4c58-bbdc-4b28685c6d41 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1358 microversion: 2.1 time: 0.173827 Oct 19 08:31:39.593812 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 559/1109] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:39 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:31:40.044862 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-65f4c5a9-cfa8-4449-bb26-e419d1d4143c tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:40.045536 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-65f4c5a9-cfa8-4449-bb26-e419d1d4143c tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:40.052036 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-65f4c5a9-cfa8-4449-bb26-e419d1d4143c tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:40.052558 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-65f4c5a9-cfa8-4449-bb26-e419d1d4143c tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:40.053390 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-65f4c5a9-cfa8-4449-bb26-e419d1d4143c tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:40.053893 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-65f4c5a9-cfa8-4449-bb26-e419d1d4143c tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:40.176774 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-65f4c5a9-cfa8-4449-bb26-e419d1d4143c tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:40.185803 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-65f4c5a9-cfa8-4449-bb26-e419d1d4143c tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1260 microversion: 2.1 time: 0.144291 Oct 19 08:31:40.187889 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 551/1110] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:40 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1260 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:40.556055 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-5f5993aa-4eba-447d-8089-f4e899cd5b20 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:40.556654 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-5f5993aa-4eba-447d-8089-f4e899cd5b20 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:40.562720 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5f5993aa-4eba-447d-8089-f4e899cd5b20 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:40.563659 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5f5993aa-4eba-447d-8089-f4e899cd5b20 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:40.564550 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5f5993aa-4eba-447d-8089-f4e899cd5b20 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:40.564978 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5f5993aa-4eba-447d-8089-f4e899cd5b20 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:40.609809 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-866952c4-910d-4112-bd30-45dea573ffb6 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:40.610627 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-866952c4-910d-4112-bd30-45dea573ffb6 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:40.616175 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-866952c4-910d-4112-bd30-45dea573ffb6 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:40.616622 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-866952c4-910d-4112-bd30-45dea573ffb6 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:40.617393 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-866952c4-910d-4112-bd30-45dea573ffb6 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:40.617824 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-866952c4-910d-4112-bd30-45dea573ffb6 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:40.717223 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-5f5993aa-4eba-447d-8089-f4e899cd5b20 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:40.725278 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-5f5993aa-4eba-447d-8089-f4e899cd5b20 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1265 microversion: 2.1 time: 0.172909 Oct 19 08:31:40.725857 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 560/1111] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:40 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:40.771940 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-866952c4-910d-4112-bd30-45dea573ffb6 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:40.779115 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-866952c4-910d-4112-bd30-45dea573ffb6 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1358 microversion: 2.1 time: 0.172796 Oct 19 08:31:40.779672 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 552/1112] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:40 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:31:41.203060 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b515e76c-785e-4508-8a2a-2020f3ef221d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:41.203941 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b515e76c-785e-4508-8a2a-2020f3ef221d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:41.210196 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b515e76c-785e-4508-8a2a-2020f3ef221d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:41.210688 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b515e76c-785e-4508-8a2a-2020f3ef221d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:41.211437 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b515e76c-785e-4508-8a2a-2020f3ef221d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:41.211857 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b515e76c-785e-4508-8a2a-2020f3ef221d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:41.334474 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-b515e76c-785e-4508-8a2a-2020f3ef221d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:41.341919 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b515e76c-785e-4508-8a2a-2020f3ef221d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1260 microversion: 2.1 time: 0.142571 Oct 19 08:31:41.349197 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 561/1113] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:41 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:41.742130 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-274bbcf7-ecc8-49b0-8270-9d135b54297f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:41.742763 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-274bbcf7-ecc8-49b0-8270-9d135b54297f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:41.748637 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-274bbcf7-ecc8-49b0-8270-9d135b54297f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:41.749095 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-274bbcf7-ecc8-49b0-8270-9d135b54297f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:41.749861 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-274bbcf7-ecc8-49b0-8270-9d135b54297f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:41.750340 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-274bbcf7-ecc8-49b0-8270-9d135b54297f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:41.795716 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a31e3259-a24d-4098-b47e-61c3e98f5cf0 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:41.796265 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a31e3259-a24d-4098-b47e-61c3e98f5cf0 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:41.801962 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a31e3259-a24d-4098-b47e-61c3e98f5cf0 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:41.802407 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a31e3259-a24d-4098-b47e-61c3e98f5cf0 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:41.803202 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a31e3259-a24d-4098-b47e-61c3e98f5cf0 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:41.803631 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a31e3259-a24d-4098-b47e-61c3e98f5cf0 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:41.901191 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-274bbcf7-ecc8-49b0-8270-9d135b54297f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:41.910365 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-274bbcf7-ecc8-49b0-8270-9d135b54297f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1265 microversion: 2.1 time: 0.172627 Oct 19 08:31:41.911004 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 553/1114] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:41 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:41.958770 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a31e3259-a24d-4098-b47e-61c3e98f5cf0 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:41.966027 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a31e3259-a24d-4098-b47e-61c3e98f5cf0 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1358 microversion: 2.1 time: 0.174067 Oct 19 08:31:41.966598 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 562/1115] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:41 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:42.359043 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-864d07f5-3fa1-4db3-b51d-de5aa497e063 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:42.359689 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-864d07f5-3fa1-4db3-b51d-de5aa497e063 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:42.365471 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-864d07f5-3fa1-4db3-b51d-de5aa497e063 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:42.365909 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-864d07f5-3fa1-4db3-b51d-de5aa497e063 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:42.366693 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-864d07f5-3fa1-4db3-b51d-de5aa497e063 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:42.367119 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-864d07f5-3fa1-4db3-b51d-de5aa497e063 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:42.488750 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-864d07f5-3fa1-4db3-b51d-de5aa497e063 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:42.496117 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-864d07f5-3fa1-4db3-b51d-de5aa497e063 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1260 microversion: 2.1 time: 0.140704 Oct 19 08:31:42.496665 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 554/1116] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:42 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1260 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:42.927365 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b74923f9-5261-4476-89d1-e90e4dd33f98 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:42.927981 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b74923f9-5261-4476-89d1-e90e4dd33f98 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:42.933754 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b74923f9-5261-4476-89d1-e90e4dd33f98 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:42.934204 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b74923f9-5261-4476-89d1-e90e4dd33f98 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:42.934959 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b74923f9-5261-4476-89d1-e90e4dd33f98 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:42.935379 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b74923f9-5261-4476-89d1-e90e4dd33f98 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:42.983559 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-00bcea40-5808-44cf-8707-993698a5ecb6 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:42.984184 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-00bcea40-5808-44cf-8707-993698a5ecb6 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:42.990413 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-00bcea40-5808-44cf-8707-993698a5ecb6 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:42.990887 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-00bcea40-5808-44cf-8707-993698a5ecb6 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:42.991645 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-00bcea40-5808-44cf-8707-993698a5ecb6 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:42.992074 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-00bcea40-5808-44cf-8707-993698a5ecb6 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:43.082432 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-b74923f9-5261-4476-89d1-e90e4dd33f98 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:43.089584 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b74923f9-5261-4476-89d1-e90e4dd33f98 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1265 microversion: 2.1 time: 0.165839 Oct 19 08:31:43.090141 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 563/1117] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:42 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:43.135236 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-00bcea40-5808-44cf-8707-993698a5ecb6 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:43.142427 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-00bcea40-5808-44cf-8707-993698a5ecb6 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1358 microversion: 2.1 time: 0.162512 Oct 19 08:31:43.143008 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 555/1118] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:42 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:31:43.512112 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-acba5c01-f31a-40f6-b0ec-14394f316e18 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:43.512702 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-acba5c01-f31a-40f6-b0ec-14394f316e18 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:43.518810 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-acba5c01-f31a-40f6-b0ec-14394f316e18 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:43.519245 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-acba5c01-f31a-40f6-b0ec-14394f316e18 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:43.519992 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-acba5c01-f31a-40f6-b0ec-14394f316e18 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:43.520412 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-acba5c01-f31a-40f6-b0ec-14394f316e18 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:43.639855 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-acba5c01-f31a-40f6-b0ec-14394f316e18 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:43.647116 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-acba5c01-f31a-40f6-b0ec-14394f316e18 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1260 microversion: 2.1 time: 0.138886 Oct 19 08:31:43.647671 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 564/1119] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:43 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1260 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:44.105289 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-b32d7538-bcce-4a3b-b1a5-ba1eb97f7702 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:44.105894 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-b32d7538-bcce-4a3b-b1a5-ba1eb97f7702 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:44.112366 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b32d7538-bcce-4a3b-b1a5-ba1eb97f7702 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:44.112807 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b32d7538-bcce-4a3b-b1a5-ba1eb97f7702 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:44.113555 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b32d7538-bcce-4a3b-b1a5-ba1eb97f7702 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:44.113978 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b32d7538-bcce-4a3b-b1a5-ba1eb97f7702 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:44.159509 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-7429d832-9147-4aa1-9b69-4854cd4fed67 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:44.160115 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-7429d832-9147-4aa1-9b69-4854cd4fed67 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:44.165837 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7429d832-9147-4aa1-9b69-4854cd4fed67 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:44.166283 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7429d832-9147-4aa1-9b69-4854cd4fed67 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:44.167107 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7429d832-9147-4aa1-9b69-4854cd4fed67 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:44.167537 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7429d832-9147-4aa1-9b69-4854cd4fed67 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:44.259528 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-b32d7538-bcce-4a3b-b1a5-ba1eb97f7702 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:44.267070 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-b32d7538-bcce-4a3b-b1a5-ba1eb97f7702 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1265 microversion: 2.1 time: 0.165414 Oct 19 08:31:44.267632 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 556/1120] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:44 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:44.309227 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-7429d832-9147-4aa1-9b69-4854cd4fed67 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:44.316393 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-7429d832-9147-4aa1-9b69-4854cd4fed67 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1358 microversion: 2.1 time: 0.161237 Oct 19 08:31:44.316951 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 565/1121] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:44 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:31:44.663656 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-336745be-862e-4baf-b2ee-eb49765c6633 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:44.664184 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-336745be-862e-4baf-b2ee-eb49765c6633 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:44.669933 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-336745be-862e-4baf-b2ee-eb49765c6633 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:44.670368 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-336745be-862e-4baf-b2ee-eb49765c6633 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:44.671154 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-336745be-862e-4baf-b2ee-eb49765c6633 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:44.671572 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-336745be-862e-4baf-b2ee-eb49765c6633 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:44.790330 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-336745be-862e-4baf-b2ee-eb49765c6633 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:44.797394 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-336745be-862e-4baf-b2ee-eb49765c6633 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1260 microversion: 2.1 time: 0.137463 Oct 19 08:31:44.798059 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 557/1122] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:44 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1260 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:45.283915 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-9bc4fe3d-855f-48c2-8fa9-faf63fc1eace tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:45.284540 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-9bc4fe3d-855f-48c2-8fa9-faf63fc1eace tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:45.290233 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9bc4fe3d-855f-48c2-8fa9-faf63fc1eace tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:45.290703 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9bc4fe3d-855f-48c2-8fa9-faf63fc1eace tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:45.291549 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9bc4fe3d-855f-48c2-8fa9-faf63fc1eace tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:45.291981 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9bc4fe3d-855f-48c2-8fa9-faf63fc1eace tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:45.333315 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-9586d2f4-d459-4cdb-8b5b-ab4076990458 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:45.333926 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-9586d2f4-d459-4cdb-8b5b-ab4076990458 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:45.339731 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9586d2f4-d459-4cdb-8b5b-ab4076990458 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:45.340166 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9586d2f4-d459-4cdb-8b5b-ab4076990458 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:45.340916 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9586d2f4-d459-4cdb-8b5b-ab4076990458 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:45.341338 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9586d2f4-d459-4cdb-8b5b-ab4076990458 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:45.832074 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-9bc4fe3d-855f-48c2-8fa9-faf63fc1eace tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:45.841188 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-9586d2f4-d459-4cdb-8b5b-ab4076990458 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:45.841352 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-9bc4fe3d-855f-48c2-8fa9-faf63fc1eace tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1265 microversion: 2.1 time: 0.561883 Oct 19 08:31:45.841808 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 566/1123] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:45 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1265 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:45.850202 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-9586d2f4-d459-4cdb-8b5b-ab4076990458 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1358 microversion: 2.1 time: 0.520138 Oct 19 08:31:45.851088 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 558/1124] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:45 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1358 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:31:45.854037 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-7acd755a-a74a-4c64-8fd0-9159cfcab95d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:45.854723 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-7acd755a-a74a-4c64-8fd0-9159cfcab95d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:45.860762 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7acd755a-a74a-4c64-8fd0-9159cfcab95d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:45.861194 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7acd755a-a74a-4c64-8fd0-9159cfcab95d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:45.861957 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7acd755a-a74a-4c64-8fd0-9159cfcab95d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:45.862379 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7acd755a-a74a-4c64-8fd0-9159cfcab95d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:46.037538 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-308078a5-2bbd-41e5-b4ca-1a333fbdffcc req-c34155ca-2200-4ada-b34e-526207a3e155 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7189072d-755e-4aa2-b182-d679f0abe991", "tag": "5b3bdd50-50bd-4849-bb58-8d9b2a088787"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:31:46.039534 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:31:46.039534 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:31:46.046874 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-308078a5-2bbd-41e5-b4ca-1a333fbdffcc req-c34155ca-2200-4ada-b34e-526207a3e155 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:46.047307 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-308078a5-2bbd-41e5-b4ca-1a333fbdffcc req-c34155ca-2200-4ada-b34e-526207a3e155 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:46.063788 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-308078a5-2bbd-41e5-b4ca-1a333fbdffcc req-c34155ca-2200-4ada-b34e-526207a3e155 service nova] Creating event network-changed:5b3bdd50-50bd-4849-bb58-8d9b2a088787 for instance 7189072d-755e-4aa2-b182-d679f0abe991 on hv-cinder-81398 Oct 19 08:31:46.064366 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-7acd755a-a74a-4c64-8fd0-9159cfcab95d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:46.068789 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-308078a5-2bbd-41e5-b4ca-1a333fbdffcc req-c34155ca-2200-4ada-b34e-526207a3e155 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037439 Oct 19 08:31:46.069382 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 559/1125] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:31:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 08:31:46.075784 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-7acd755a-a74a-4c64-8fd0-9159cfcab95d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1445 microversion: 2.1 time: 0.225444 Oct 19 08:31:46.076548 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 567/1126] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:45 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1445 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:46.093012 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-b9a387c9-271f-4c08-b268-70d35b54a020 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:46.093707 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-b9a387c9-271f-4c08-b268-70d35b54a020 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:46.100712 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b9a387c9-271f-4c08-b268-70d35b54a020 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:46.101153 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b9a387c9-271f-4c08-b268-70d35b54a020 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:46.101925 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b9a387c9-271f-4c08-b268-70d35b54a020 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:46.102352 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b9a387c9-271f-4c08-b268-70d35b54a020 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:46.322287 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-b9a387c9-271f-4c08-b268-70d35b54a020 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:46.331596 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-b9a387c9-271f-4c08-b268-70d35b54a020 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1445 microversion: 2.1 time: 0.242553 Oct 19 08:31:46.332166 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 560/1127] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:46 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1445 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:46.857207 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3922c97f-3320-4237-bdda-96289ce6aa07 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:46.858409 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3922c97f-3320-4237-bdda-96289ce6aa07 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:46.864488 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3922c97f-3320-4237-bdda-96289ce6aa07 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:46.865078 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3922c97f-3320-4237-bdda-96289ce6aa07 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:46.865954 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c8ee6b6e-266c-4d67-b71f-ac0d9b12e997 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:46.866581 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-c8ee6b6e-266c-4d67-b71f-ac0d9b12e997 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:46.866727 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3922c97f-3320-4237-bdda-96289ce6aa07 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:46.867245 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3922c97f-3320-4237-bdda-96289ce6aa07 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:46.874196 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c8ee6b6e-266c-4d67-b71f-ac0d9b12e997 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:46.877153 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c8ee6b6e-266c-4d67-b71f-ac0d9b12e997 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:46.878241 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c8ee6b6e-266c-4d67-b71f-ac0d9b12e997 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:46.878903 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c8ee6b6e-266c-4d67-b71f-ac0d9b12e997 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:47.142504 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3922c97f-3320-4237-bdda-96289ce6aa07 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:47.150416 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-c8ee6b6e-266c-4d67-b71f-ac0d9b12e997 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:47.154136 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3922c97f-3320-4237-bdda-96289ce6aa07 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1265 microversion: 2.1 time: 0.300082 Oct 19 08:31:47.155369 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 568/1128] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:46 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1265 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:47.159089 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-c8ee6b6e-266c-4d67-b71f-ac0d9b12e997 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1358 microversion: 2.1 time: 0.296512 Oct 19 08:31:47.165532 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 561/1129] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:46 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1358 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:48.171138 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-d3d0a61a-79f7-46ae-8739-35a5020b95c3 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:48.171782 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-d3d0a61a-79f7-46ae-8739-35a5020b95c3 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:48.176127 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-bda10b49-2fdd-49ca-b2e1-9d8cb12f4164 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:48.177385 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-bda10b49-2fdd-49ca-b2e1-9d8cb12f4164 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:48.178254 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d3d0a61a-79f7-46ae-8739-35a5020b95c3 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:48.178771 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d3d0a61a-79f7-46ae-8739-35a5020b95c3 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:48.179549 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d3d0a61a-79f7-46ae-8739-35a5020b95c3 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:48.179975 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d3d0a61a-79f7-46ae-8739-35a5020b95c3 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:48.183310 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bda10b49-2fdd-49ca-b2e1-9d8cb12f4164 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:48.183756 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bda10b49-2fdd-49ca-b2e1-9d8cb12f4164 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:48.184517 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bda10b49-2fdd-49ca-b2e1-9d8cb12f4164 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:48.185011 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bda10b49-2fdd-49ca-b2e1-9d8cb12f4164 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:48.366237 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-d3d0a61a-79f7-46ae-8739-35a5020b95c3 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:48.373715 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-d3d0a61a-79f7-46ae-8739-35a5020b95c3 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1453 microversion: 2.1 time: 0.206441 Oct 19 08:31:48.374277 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 569/1130] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:48 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1453 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:48.389404 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-bda10b49-2fdd-49ca-b2e1-9d8cb12f4164 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:48.397721 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-bda10b49-2fdd-49ca-b2e1-9d8cb12f4164 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1358 microversion: 2.1 time: 0.226017 Oct 19 08:31:48.398284 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 562/1131] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:48 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:31:48.406943 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-e81e226c-6aab-4bfb-b1b0-724943ca5695 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:48.407827 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-e81e226c-6aab-4bfb-b1b0-724943ca5695 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:48.415585 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e81e226c-6aab-4bfb-b1b0-724943ca5695 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:48.416034 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e81e226c-6aab-4bfb-b1b0-724943ca5695 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:48.416986 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e81e226c-6aab-4bfb-b1b0-724943ca5695 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:48.417552 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e81e226c-6aab-4bfb-b1b0-724943ca5695 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:48.448288 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-dc5048e9-8aab-48e0-8343-454d6151b9e6 req-1585aec2-1c6b-4358-96a1-54f3eade0f41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59c3fb17-9b00-4111-afa2-59ce69f7a986", "tag": "12a0882c-425b-45ca-9a64-43ef73c77095"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:31:48.454178 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:31:48.454178 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:31:48.464048 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-dc5048e9-8aab-48e0-8343-454d6151b9e6 req-1585aec2-1c6b-4358-96a1-54f3eade0f41 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:48.464733 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-dc5048e9-8aab-48e0-8343-454d6151b9e6 req-1585aec2-1c6b-4358-96a1-54f3eade0f41 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:48.477139 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-dc5048e9-8aab-48e0-8343-454d6151b9e6 req-1585aec2-1c6b-4358-96a1-54f3eade0f41 service nova] Creating event network-changed:12a0882c-425b-45ca-9a64-43ef73c77095 for instance 59c3fb17-9b00-4111-afa2-59ce69f7a986 on hv-cinder-81398 Oct 19 08:31:48.482140 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-dc5048e9-8aab-48e0-8343-454d6151b9e6 req-1585aec2-1c6b-4358-96a1-54f3eade0f41 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106518 Oct 19 08:31:48.482766 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 570/1132] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:31:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:31:48.570178 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-e81e226c-6aab-4bfb-b1b0-724943ca5695 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:48.578147 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-e81e226c-6aab-4bfb-b1b0-724943ca5695 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1453 microversion: 2.1 time: 0.178546 Oct 19 08:31:48.579431 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 563/1133] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:48 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1453 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:49.414139 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-cfd5aa56-ed33-4ede-9c77-9e26e0f40e96 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:49.415015 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-cfd5aa56-ed33-4ede-9c77-9e26e0f40e96 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:49.421357 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cfd5aa56-ed33-4ede-9c77-9e26e0f40e96 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:49.421912 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cfd5aa56-ed33-4ede-9c77-9e26e0f40e96 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:49.422813 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cfd5aa56-ed33-4ede-9c77-9e26e0f40e96 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:49.423234 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cfd5aa56-ed33-4ede-9c77-9e26e0f40e96 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:49.547695 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-cfd5aa56-ed33-4ede-9c77-9e26e0f40e96 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:49.554875 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-cfd5aa56-ed33-4ede-9c77-9e26e0f40e96 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1358 microversion: 2.1 time: 0.144753 Oct 19 08:31:49.555456 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 571/1134] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:49 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:49.927309 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-64dc7040-ad1d-4e6b-a62b-6d838b05b229 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:49.927859 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-64dc7040-ad1d-4e6b-a62b-6d838b05b229 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:49.933601 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-64dc7040-ad1d-4e6b-a62b-6d838b05b229 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:49.934101 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-64dc7040-ad1d-4e6b-a62b-6d838b05b229 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:49.934896 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-64dc7040-ad1d-4e6b-a62b-6d838b05b229 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:49.935323 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-64dc7040-ad1d-4e6b-a62b-6d838b05b229 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:49.965489 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-64dc7040-ad1d-4e6b-a62b-6d838b05b229 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/os-volume_attachments/be9ee660-628b-4cbf-82a4-76d19c5358be" status: 200 len: 194 microversion: 2.20 time: 0.042203 Oct 19 08:31:49.966075 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 564/1135] 10.222.0.26 () {60 vars in 1453 bytes} [Tue Oct 19 08:31:49 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/os-volume_attachments/be9ee660-628b-4cbf-82a4-76d19c5358be => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:31:50.026992 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-2bb6dfce-05f7-44ca-b355-e367faff2bc1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:50.027590 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-2bb6dfce-05f7-44ca-b355-e367faff2bc1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:50.034103 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2bb6dfce-05f7-44ca-b355-e367faff2bc1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:50.034613 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2bb6dfce-05f7-44ca-b355-e367faff2bc1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:50.035402 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2bb6dfce-05f7-44ca-b355-e367faff2bc1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:50.035835 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2bb6dfce-05f7-44ca-b355-e367faff2bc1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:50.113891 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.objects.instance [None req-2bb6dfce-05f7-44ca-b355-e367faff2bc1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lazy-loading 'services' on Instance uuid fe7dae80-4592-45ea-a52d-05aa559c102a {{(pid=114106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 19 08:31:50.180688 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-2bb6dfce-05f7-44ca-b355-e367faff2bc1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/os-volume_attachments/be9ee660-628b-4cbf-82a4-76d19c5358be" status: 202 len: 0 microversion: 2.20 time: 0.157251 Oct 19 08:31:50.181199 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 572/1136] 10.222.0.26 () {60 vars in 1456 bytes} [Tue Oct 19 08:31:50 2021] DELETE /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/os-volume_attachments/be9ee660-628b-4cbf-82a4-76d19c5358be => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 08:31:50.190248 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c4bca93d-2e62-4d4f-8fde-d68b6ffeea6a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:50.191329 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-c4bca93d-2e62-4d4f-8fde-d68b6ffeea6a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:50.197071 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c4bca93d-2e62-4d4f-8fde-d68b6ffeea6a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:50.197718 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c4bca93d-2e62-4d4f-8fde-d68b6ffeea6a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:50.198697 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c4bca93d-2e62-4d4f-8fde-d68b6ffeea6a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:50.199277 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c4bca93d-2e62-4d4f-8fde-d68b6ffeea6a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:50.231091 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-c4bca93d-2e62-4d4f-8fde-d68b6ffeea6a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045358 Oct 19 08:31:50.235380 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 565/1137] 10.222.0.26 () {60 vars in 1342 bytes} [Tue Oct 19 08:31:50 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:31:50.497122 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-c90be1d2-1a03-4458-a4af-2526147351b4 req-e311562e-9019-4890-9042-7df43a9442fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9802a026-2641-4cdf-9d05-97a5272d6d8b", "tag": "ff26f079-abb3-425c-828c-e1118d527879"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:31:50.498650 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:31:50.498650 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:31:50.505670 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-c90be1d2-1a03-4458-a4af-2526147351b4 req-e311562e-9019-4890-9042-7df43a9442fe service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:50.506103 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-c90be1d2-1a03-4458-a4af-2526147351b4 req-e311562e-9019-4890-9042-7df43a9442fe service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:50.517140 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-c90be1d2-1a03-4458-a4af-2526147351b4 req-e311562e-9019-4890-9042-7df43a9442fe service nova] Creating event network-changed:ff26f079-abb3-425c-828c-e1118d527879 for instance 9802a026-2641-4cdf-9d05-97a5272d6d8b on hv-cinder-81398 Oct 19 08:31:50.521851 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-c90be1d2-1a03-4458-a4af-2526147351b4 req-e311562e-9019-4890-9042-7df43a9442fe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028605 Oct 19 08:31:50.522671 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 573/1138] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:31:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 08:31:50.572089 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-f0441e77-bf8f-47fc-b20a-f09330c106c5 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:50.572724 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-f0441e77-bf8f-47fc-b20a-f09330c106c5 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:50.579232 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f0441e77-bf8f-47fc-b20a-f09330c106c5 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:50.579674 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f0441e77-bf8f-47fc-b20a-f09330c106c5 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:50.580537 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f0441e77-bf8f-47fc-b20a-f09330c106c5 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:50.580971 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f0441e77-bf8f-47fc-b20a-f09330c106c5 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:50.771332 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-f0441e77-bf8f-47fc-b20a-f09330c106c5 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:50.778759 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-f0441e77-bf8f-47fc-b20a-f09330c106c5 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1358 microversion: 2.1 time: 0.210316 Oct 19 08:31:50.779515 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 566/1139] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:50 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:51.243627 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-6605dc57-c18f-4975-8ee4-e2efd25d862e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:51.244618 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-6605dc57-c18f-4975-8ee4-e2efd25d862e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:51.251264 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6605dc57-c18f-4975-8ee4-e2efd25d862e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:51.251705 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6605dc57-c18f-4975-8ee4-e2efd25d862e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:51.252471 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6605dc57-c18f-4975-8ee4-e2efd25d862e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:51.252898 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6605dc57-c18f-4975-8ee4-e2efd25d862e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:51.284211 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-6605dc57-c18f-4975-8ee4-e2efd25d862e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044661 Oct 19 08:31:51.284778 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 574/1140] 10.222.0.26 () {60 vars in 1342 bytes} [Tue Oct 19 08:31:51 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:51.341172 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c47d2c51-7b3c-4b38-90b8-cce300b90c71 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:51.341706 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-c47d2c51-7b3c-4b38-90b8-cce300b90c71 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:51.348420 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c47d2c51-7b3c-4b38-90b8-cce300b90c71 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:51.348866 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c47d2c51-7b3c-4b38-90b8-cce300b90c71 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:51.349640 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c47d2c51-7b3c-4b38-90b8-cce300b90c71 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:51.350286 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c47d2c51-7b3c-4b38-90b8-cce300b90c71 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:51.376869 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-c47d2c51-7b3c-4b38-90b8-cce300b90c71 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Going to try to terminate instance {{(pid=114105) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 19 08:31:51.454724 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-c47d2c51-7b3c-4b38-90b8-cce300b90c71 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 204 len: 0 microversion: 2.20 time: 0.116796 Oct 19 08:31:51.455783 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 567/1141] 10.222.0.26 () {60 vars in 1279 bytes} [Tue Oct 19 08:31:51 2021] DELETE /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 08:31:51.464091 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-221a658c-be1d-41c5-917c-f691402799c5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:51.464768 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-221a658c-be1d-41c5-917c-f691402799c5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:51.471370 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-221a658c-be1d-41c5-917c-f691402799c5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:51.471877 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-221a658c-be1d-41c5-917c-f691402799c5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:51.472693 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-221a658c-be1d-41c5-917c-f691402799c5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:51.473184 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-221a658c-be1d-41c5-917c-f691402799c5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:51.596223 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-221a658c-be1d-41c5-917c-f691402799c5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:51.603857 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-221a658c-be1d-41c5-917c-f691402799c5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:51.605324 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-221a658c-be1d-41c5-917c-f691402799c5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:51.606459 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-221a658c-be1d-41c5-917c-f691402799c5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1725 microversion: 2.20 time: 0.146101 Oct 19 08:31:51.607031 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 575/1142] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:31:51 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:31:51.779336 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-45800b11-81da-4a41-8634-2fec8479866b req-6f07270f-2ee6-4ecc-a3d6-e56ae19a9088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7189072d-755e-4aa2-b182-d679f0abe991", "name": "network-vif-plugged", "status": "completed", "tag": "5b3bdd50-50bd-4849-bb58-8d9b2a088787"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:31:51.780810 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:31:51.780810 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:31:51.787651 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-45800b11-81da-4a41-8634-2fec8479866b req-6f07270f-2ee6-4ecc-a3d6-e56ae19a9088 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:51.788092 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-45800b11-81da-4a41-8634-2fec8479866b req-6f07270f-2ee6-4ecc-a3d6-e56ae19a9088 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:51.798942 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b006963e-18fb-46e0-ab0d-ecefcde2797a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:51.799603 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b006963e-18fb-46e0-ab0d-ecefcde2797a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:51.805468 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-45800b11-81da-4a41-8634-2fec8479866b req-6f07270f-2ee6-4ecc-a3d6-e56ae19a9088 service nova] Creating event network-vif-plugged:5b3bdd50-50bd-4849-bb58-8d9b2a088787 for instance 7189072d-755e-4aa2-b182-d679f0abe991 on hv-cinder-81398 Oct 19 08:31:51.805678 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b006963e-18fb-46e0-ab0d-ecefcde2797a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:51.806219 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b006963e-18fb-46e0-ab0d-ecefcde2797a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:51.807130 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b006963e-18fb-46e0-ab0d-ecefcde2797a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:51.807647 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b006963e-18fb-46e0-ab0d-ecefcde2797a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:51.810423 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-45800b11-81da-4a41-8634-2fec8479866b req-6f07270f-2ee6-4ecc-a3d6-e56ae19a9088 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034957 Oct 19 08:31:51.811475 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 568/1143] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:31:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 08:31:51.936432 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-b006963e-18fb-46e0-ab0d-ecefcde2797a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:51.943992 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b006963e-18fb-46e0-ab0d-ecefcde2797a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1358 microversion: 2.1 time: 0.151544 Oct 19 08:31:51.944552 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 576/1144] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:51 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:31:52.626524 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-3a38f2ed-14d9-4454-9305-f5fef78a3a0e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:52.627224 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-3a38f2ed-14d9-4454-9305-f5fef78a3a0e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:52.633255 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3a38f2ed-14d9-4454-9305-f5fef78a3a0e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:52.633697 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3a38f2ed-14d9-4454-9305-f5fef78a3a0e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:52.634507 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3a38f2ed-14d9-4454-9305-f5fef78a3a0e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:52.634938 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3a38f2ed-14d9-4454-9305-f5fef78a3a0e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:52.754922 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-3a38f2ed-14d9-4454-9305-f5fef78a3a0e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:52.762772 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-3a38f2ed-14d9-4454-9305-f5fef78a3a0e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:52.764255 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-3a38f2ed-14d9-4454-9305-f5fef78a3a0e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:52.765394 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-3a38f2ed-14d9-4454-9305-f5fef78a3a0e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1725 microversion: 2.20 time: 0.143611 Oct 19 08:31:52.766054 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 569/1145] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:31:52 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1725 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:31:52.960404 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-771e92ac-61ed-4700-b644-3fddcb7577b8 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:52.961010 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-771e92ac-61ed-4700-b644-3fddcb7577b8 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:52.966974 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-771e92ac-61ed-4700-b644-3fddcb7577b8 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:52.967355 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-771e92ac-61ed-4700-b644-3fddcb7577b8 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:52.968101 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-771e92ac-61ed-4700-b644-3fddcb7577b8 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:52.968526 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-771e92ac-61ed-4700-b644-3fddcb7577b8 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:53.088889 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-771e92ac-61ed-4700-b644-3fddcb7577b8 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:53.096655 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-771e92ac-61ed-4700-b644-3fddcb7577b8 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1358 microversion: 2.1 time: 0.139866 Oct 19 08:31:53.097211 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 577/1146] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:52 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1358 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:53.783222 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-7c75ea6d-335d-42aa-949d-68db69deb585 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:53.783836 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-7c75ea6d-335d-42aa-949d-68db69deb585 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:53.789841 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7c75ea6d-335d-42aa-949d-68db69deb585 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:53.790283 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7c75ea6d-335d-42aa-949d-68db69deb585 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:53.791084 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7c75ea6d-335d-42aa-949d-68db69deb585 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:53.791513 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7c75ea6d-335d-42aa-949d-68db69deb585 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:53.988918 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-7c75ea6d-335d-42aa-949d-68db69deb585 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:53.996792 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-7c75ea6d-335d-42aa-949d-68db69deb585 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:53.998301 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-7c75ea6d-335d-42aa-949d-68db69deb585 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:53.999504 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-7c75ea6d-335d-42aa-949d-68db69deb585 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1725 microversion: 2.20 time: 0.220439 Oct 19 08:31:54.000056 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 570/1147] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:31:53 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:31:54.113203 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-58e2748b-821f-4002-96fd-b5c7a2030beb tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:54.113807 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-58e2748b-821f-4002-96fd-b5c7a2030beb tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:54.119814 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-58e2748b-821f-4002-96fd-b5c7a2030beb tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:54.120253 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-58e2748b-821f-4002-96fd-b5c7a2030beb tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:54.121020 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-58e2748b-821f-4002-96fd-b5c7a2030beb tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:54.121447 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-58e2748b-821f-4002-96fd-b5c7a2030beb tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:54.608928 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-58e2748b-821f-4002-96fd-b5c7a2030beb tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:54.616548 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-58e2748b-821f-4002-96fd-b5c7a2030beb tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1549 microversion: 2.1 time: 0.507284 Oct 19 08:31:54.617113 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 578/1148] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:54 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1549 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:54.632861 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-1547a690-1b78-4a17-8614-3630558064b2 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:54.633464 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-1547a690-1b78-4a17-8614-3630558064b2 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:54.639423 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1547a690-1b78-4a17-8614-3630558064b2 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:54.639863 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1547a690-1b78-4a17-8614-3630558064b2 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:54.640623 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1547a690-1b78-4a17-8614-3630558064b2 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:54.641052 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1547a690-1b78-4a17-8614-3630558064b2 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:54.831653 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-1547a690-1b78-4a17-8614-3630558064b2 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:54.842352 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-1547a690-1b78-4a17-8614-3630558064b2 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1549 microversion: 2.1 time: 0.212977 Oct 19 08:31:54.843154 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 571/1149] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:54 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1549 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:31:54.857731 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-62cc1187-cdc3-4297-b1fe-0a57d2fc6aac tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:54.861541 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:31:54.861541 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:31:54.862531 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-62cc1187-cdc3-4297-b1fe-0a57d2fc6aac tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:54.863208 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-62cc1187-cdc3-4297-b1fe-0a57d2fc6aac tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Searching by: {'deleted': False, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd'} {{(pid=114106) get_all /opt/stack/nova/nova/compute/api.py:2905}} Oct 19 08:31:54.870047 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-62cc1187-cdc3-4297-b1fe-0a57d2fc6aac tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:54.870727 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-62cc1187-cdc3-4297-b1fe-0a57d2fc6aac tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:54.872108 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-62cc1187-cdc3-4297-b1fe-0a57d2fc6aac tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:54.872532 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-62cc1187-cdc3-4297-b1fe-0a57d2fc6aac tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:54.965283 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.multi_cell_list [None req-62cc1187-cdc3-4297-b1fe-0a57d2fc6aac tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=114106) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Oct 19 08:31:55.018406 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8205ac31-0d82-4fdd-b88b-1e4e668d3047 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:55.019568 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-8205ac31-0d82-4fdd-b88b-1e4e668d3047 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:55.027341 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8205ac31-0d82-4fdd-b88b-1e4e668d3047 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:55.028117 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8205ac31-0d82-4fdd-b88b-1e4e668d3047 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:55.029213 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8205ac31-0d82-4fdd-b88b-1e4e668d3047 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:55.030138 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8205ac31-0d82-4fdd-b88b-1e4e668d3047 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:55.083515 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-62cc1187-cdc3-4297-b1fe-0a57d2fc6aac tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.229260 Oct 19 08:31:55.085097 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 579/1150] 10.222.0.26 () {58 vars in 1124 bytes} [Tue Oct 19 08:31:54 2021] GET /compute/v2.1/servers => generated 342 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:31:55.095558 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-429fd46d-8c97-4809-89d9-ff6c1f95ea08 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:55.096509 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-429fd46d-8c97-4809-89d9-ff6c1f95ea08 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:55.103098 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-429fd46d-8c97-4809-89d9-ff6c1f95ea08 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:55.104061 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-429fd46d-8c97-4809-89d9-ff6c1f95ea08 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:55.105059 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-429fd46d-8c97-4809-89d9-ff6c1f95ea08 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:55.105726 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-429fd46d-8c97-4809-89d9-ff6c1f95ea08 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:55.119143 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-8205ac31-0d82-4fdd-b88b-1e4e668d3047 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:55.128294 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-8205ac31-0d82-4fdd-b88b-1e4e668d3047 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:55.130598 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-8205ac31-0d82-4fdd-b88b-1e4e668d3047 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:55.131965 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-8205ac31-0d82-4fdd-b88b-1e4e668d3047 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 200 len: 1657 microversion: 2.20 time: 0.117818 Oct 19 08:31:55.133122 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 572/1151] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:31:55 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 1657 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:31:55.170840 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-6906e8b9-41a8-4f1b-b8b9-475d4cedc079 req-78584f32-1e92-4206-9763-703be2459ccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7dae80-4592-45ea-a52d-05aa559c102a", "name": "network-vif-deleted", "tag": "3ccfabb1-82b3-4904-a943-c29622e0b546"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:31:55.173084 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:31:55.173084 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:31:55.180446 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-6906e8b9-41a8-4f1b-b8b9-475d4cedc079 req-78584f32-1e92-4206-9763-703be2459ccf service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:55.181132 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-6906e8b9-41a8-4f1b-b8b9-475d4cedc079 req-78584f32-1e92-4206-9763-703be2459ccf service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:55.204208 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-6906e8b9-41a8-4f1b-b8b9-475d4cedc079 req-78584f32-1e92-4206-9763-703be2459ccf service nova] Creating event network-vif-deleted:3ccfabb1-82b3-4904-a943-c29622e0b546 for instance fe7dae80-4592-45ea-a52d-05aa559c102a on hv-cinder-81398 Oct 19 08:31:55.209526 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-6906e8b9-41a8-4f1b-b8b9-475d4cedc079 req-78584f32-1e92-4206-9763-703be2459ccf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043141 Oct 19 08:31:55.210385 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 573/1152] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:31:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:31:55.289886 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-429fd46d-8c97-4809-89d9-ff6c1f95ea08 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:55.301558 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-429fd46d-8c97-4809-89d9-ff6c1f95ea08 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1549 microversion: 2.1 time: 0.210495 Oct 19 08:31:55.302317 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 580/1153] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:31:55 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1549 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:31:56.151189 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-278b8022-f278-404f-8f27-89b044712931 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:56.151887 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-278b8022-f278-404f-8f27-89b044712931 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:56.158447 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-278b8022-f278-404f-8f27-89b044712931 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:56.158922 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-278b8022-f278-404f-8f27-89b044712931 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:56.159690 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-278b8022-f278-404f-8f27-89b044712931 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:56.160124 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-278b8022-f278-404f-8f27-89b044712931 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:56.174453 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.wsgi [None req-278b8022-f278-404f-8f27-89b044712931 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] HTTP exception thrown: Instance fe7dae80-4592-45ea-a52d-05aa559c102a could not be found. Oct 19 08:31:56.175350 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-278b8022-f278-404f-8f27-89b044712931 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Returning 404 to user: Instance fe7dae80-4592-45ea-a52d-05aa559c102a could not be found. {{(pid=114105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:31:56.176353 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-278b8022-f278-404f-8f27-89b044712931 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 404 len: 111 microversion: 2.20 time: 0.029376 Oct 19 08:31:56.177407 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 574/1154] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:31:56 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 08:31:56.185572 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-521e8c56-6504-4d2c-b6d4-c9db85e0a6d5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '.version_select at 0x7fcadd9731f0>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:56.205604 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-521e8c56-6504-4d2c-b6d4-c9db85e0a6d5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-510185428" status: 204 len: 0 microversion: 2.20 time: 0.023753 Oct 19 08:31:56.206468 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 581/1155] 10.222.0.26 () {60 vars in 1258 bytes} [Tue Oct 19 08:31:56 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-510185428 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 19 08:31:56.851508 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d0bbecb0-754c-408a-95ac-7088b7adb9dd tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb605757-b4d3-4882-94f4-c33eb340204a"}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:31:56.852786 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-d0bbecb0-754c-408a-95ac-7088b7adb9dd tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:56.858741 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d0bbecb0-754c-408a-95ac-7088b7adb9dd tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:56.859315 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d0bbecb0-754c-408a-95ac-7088b7adb9dd tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:56.860802 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d0bbecb0-754c-408a-95ac-7088b7adb9dd tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:56.861328 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d0bbecb0-754c-408a-95ac-7088b7adb9dd tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:57.091116 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-d0bbecb0-754c-408a-95ac-7088b7adb9dd tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "POST /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.243146 Oct 19 08:31:57.091970 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 575/1156] 10.222.0.26 () {60 vars in 1322 bytes} [Tue Oct 19 08:31:56 2021] POST /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991/os-volume_attachments => generated 194 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:31:57.192205 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-287931b2-ef74-4593-84fc-196950871eae tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'create', calling method: .version_select at 0x7fcadd0f3d30>, body: {"keypair": {"name": "tempest-keypair-283748760"}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:31:57.209759 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-287931b2-ef74-4593-84fc-196950871eae tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Getting quotas for project 6ffc881ce1324822826aec5e72a754b4. Resources: {'key_pairs'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:31:57.213518 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-287931b2-ef74-4593-84fc-196950871eae tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Getting quotas for user 3ba4c5d03e21424eb9b326bddefbf34a and project 6ffc881ce1324822826aec5e72a754b4. Resources: {'key_pairs'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:31:57.366248 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-287931b2-ef74-4593-84fc-196950871eae tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Getting quotas for project 6ffc881ce1324822826aec5e72a754b4. Resources: {'key_pairs'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:31:57.370219 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-287931b2-ef74-4593-84fc-196950871eae tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Getting quotas for user 3ba4c5d03e21424eb9b326bddefbf34a and project 6ffc881ce1324822826aec5e72a754b4. Resources: {'key_pairs'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:31:57.385569 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-287931b2-ef74-4593-84fc-196950871eae tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.196909 Oct 19 08:31:57.390769 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 582/1157] 10.222.0.26 () {62 vars in 1198 bytes} [Tue Oct 19 08:31:57 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 203 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Oct 19 08:31:58.625038 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-30ad4b12-47ac-4487-800d-6ad404457d5d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1166510413", "imageRef": "9102a998-a580-4b4e-b6a1-3172273dd66d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b7c9676-b604-477b-a586-63579afd5719"}], "security_groups": [{"name": "tempest-securitygroup--1133006983"}], "key_name": "tempest-keypair-283748760", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:31:58.716409 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.network.neutron [None req-30ad4b12-47ac-4487-800d-6ad404457d5d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] validate_networks() for [('8b7c9676-b604-477b-a586-63579afd5719', None, None, None, None, None)] {{(pid=114105) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 19 08:31:59.074988 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-30ad4b12-47ac-4487-800d-6ad404457d5d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Flavor limits 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 08:31:59.075440 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-30ad4b12-47ac-4487-800d-6ad404457d5d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Image limits 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 08:31:59.075937 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-30ad4b12-47ac-4487-800d-6ad404457d5d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Flavor pref 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 08:31:59.076342 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-30ad4b12-47ac-4487-800d-6ad404457d5d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Image pref 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 08:31:59.076747 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-30ad4b12-47ac-4487-800d-6ad404457d5d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 08:31:59.086036 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-30ad4b12-47ac-4487-800d-6ad404457d5d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:59.086484 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-30ad4b12-47ac-4487-800d-6ad404457d5d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:59.087310 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-30ad4b12-47ac-4487-800d-6ad404457d5d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:31:59.087740 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-30ad4b12-47ac-4487-800d-6ad404457d5d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:31:59.103858 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-30ad4b12-47ac-4487-800d-6ad404457d5d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Getting quotas for project 6ffc881ce1324822826aec5e72a754b4. Resources: {'cores', 'instances', 'ram'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:31:59.107629 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-30ad4b12-47ac-4487-800d-6ad404457d5d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Getting quotas for user 3ba4c5d03e21424eb9b326bddefbf34a and project 6ffc881ce1324822826aec5e72a754b4. Resources: {'cores', 'instances', 'ram'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:31:59.118520 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-30ad4b12-47ac-4487-800d-6ad404457d5d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Going to run 1 instances... {{(pid=114105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 19 08:31:59.120904 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-30ad4b12-47ac-4487-800d-6ad404457d5d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9102a998-a580-4b4e-b6a1-3172273dd66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 19 08:31:59.166454 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-30ad4b12-47ac-4487-800d-6ad404457d5d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.546260 Oct 19 08:31:59.167116 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 576/1158] 10.222.0.26 () {62 vars in 1187 bytes} [Tue Oct 19 08:31:58 2021] POST /compute/v2.1/servers => generated 402 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 08:31:59.177337 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-325a7e0c-469f-4c9b-9a7f-a740a4276c0a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:31:59.177927 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-325a7e0c-469f-4c9b-9a7f-a740a4276c0a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:31:59.232975 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-325a7e0c-469f-4c9b-9a7f-a740a4276c0a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:59.241951 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-325a7e0c-469f-4c9b-9a7f-a740a4276c0a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:59.243537 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-325a7e0c-469f-4c9b-9a7f-a740a4276c0a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:31:59.244699 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-325a7e0c-469f-4c9b-9a7f-a740a4276c0a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1281 microversion: 2.20 time: 0.071144 Oct 19 08:31:59.255557 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 583/1159] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:31:59 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1281 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:32:00.262860 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-f1ead2e4-eaba-4471-8582-419abfa09484 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:32:00.264076 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-f1ead2e4-eaba-4471-8582-419abfa09484 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:00.271166 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f1ead2e4-eaba-4471-8582-419abfa09484 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:00.271871 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f1ead2e4-eaba-4471-8582-419abfa09484 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:00.272433 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f1ead2e4-eaba-4471-8582-419abfa09484 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:00.272854 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f1ead2e4-eaba-4471-8582-419abfa09484 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:00.347276 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-f1ead2e4-eaba-4471-8582-419abfa09484 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:00.354834 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-f1ead2e4-eaba-4471-8582-419abfa09484 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:00.356309 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-f1ead2e4-eaba-4471-8582-419abfa09484 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:00.357384 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-f1ead2e4-eaba-4471-8582-419abfa09484 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1339 microversion: 2.20 time: 0.098611 Oct 19 08:32:00.357926 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 577/1160] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:32:00 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1339 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:32:01.375914 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-0643baf7-3307-4e42-98a0-9902c4c71e18 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:32:01.377144 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-0643baf7-3307-4e42-98a0-9902c4c71e18 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:01.383072 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0643baf7-3307-4e42-98a0-9902c4c71e18 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:01.383465 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0643baf7-3307-4e42-98a0-9902c4c71e18 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:01.384238 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0643baf7-3307-4e42-98a0-9902c4c71e18 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:01.384667 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0643baf7-3307-4e42-98a0-9902c4c71e18 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:01.409563 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-3ff6f2cb-a9d3-4d7b-9cc6-8f8115387280 req-d0c3e491-6fec-48c0-b887-5a888c639d22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15322fb9-3685-4ce3-9f4d-9a407835f47a", "tag": "5a96c138-97d6-476d-b751-ac066e4a3cef"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:01.411200 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:32:01.411200 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:32:01.425923 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-3ff6f2cb-a9d3-4d7b-9cc6-8f8115387280 req-d0c3e491-6fec-48c0-b887-5a888c639d22 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:01.426367 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-3ff6f2cb-a9d3-4d7b-9cc6-8f8115387280 req-d0c3e491-6fec-48c0-b887-5a888c639d22 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:01.440117 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-3ff6f2cb-a9d3-4d7b-9cc6-8f8115387280 req-d0c3e491-6fec-48c0-b887-5a888c639d22 service nova] Creating event network-changed:5a96c138-97d6-476d-b751-ac066e4a3cef for instance 15322fb9-3685-4ce3-9f4d-9a407835f47a on hv-cinder-81398 Oct 19 08:32:01.445295 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-3ff6f2cb-a9d3-4d7b-9cc6-8f8115387280 req-d0c3e491-6fec-48c0-b887-5a888c639d22 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040129 Oct 19 08:32:01.447863 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 578/1161] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:32:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:32:01.635729 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-0643baf7-3307-4e42-98a0-9902c4c71e18 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:01.644152 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-0643baf7-3307-4e42-98a0-9902c4c71e18 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:01.645641 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-0643baf7-3307-4e42-98a0-9902c4c71e18 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:01.646756 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-0643baf7-3307-4e42-98a0-9902c4c71e18 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1407 microversion: 2.20 time: 0.274586 Oct 19 08:32:01.647314 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 584/1162] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:32:01 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1407 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:32:02.664998 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-a83b322e-c0d2-4e76-ace3-c338871f3772 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:32:02.665702 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-a83b322e-c0d2-4e76-ace3-c338871f3772 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:02.671740 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a83b322e-c0d2-4e76-ace3-c338871f3772 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:02.672187 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a83b322e-c0d2-4e76-ace3-c338871f3772 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:02.673809 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a83b322e-c0d2-4e76-ace3-c338871f3772 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:02.674267 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a83b322e-c0d2-4e76-ace3-c338871f3772 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:02.792203 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-a83b322e-c0d2-4e76-ace3-c338871f3772 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:02.800432 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-a83b322e-c0d2-4e76-ace3-c338871f3772 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:02.801921 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-a83b322e-c0d2-4e76-ace3-c338871f3772 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:02.803052 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-a83b322e-c0d2-4e76-ace3-c338871f3772 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1407 microversion: 2.20 time: 0.142573 Oct 19 08:32:02.803601 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 579/1163] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:32:02 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1407 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:32:03.820712 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-df579ed7-1abd-4995-94fc-d64e6d4ed130 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:32:03.821466 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-df579ed7-1abd-4995-94fc-d64e6d4ed130 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:03.827690 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-df579ed7-1abd-4995-94fc-d64e6d4ed130 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:03.828047 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-df579ed7-1abd-4995-94fc-d64e6d4ed130 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:03.828961 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-df579ed7-1abd-4995-94fc-d64e6d4ed130 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:03.829379 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-df579ed7-1abd-4995-94fc-d64e6d4ed130 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:03.953916 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-df579ed7-1abd-4995-94fc-d64e6d4ed130 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:03.961539 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-df579ed7-1abd-4995-94fc-d64e6d4ed130 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:03.963065 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-df579ed7-1abd-4995-94fc-d64e6d4ed130 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:03.964155 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-df579ed7-1abd-4995-94fc-d64e6d4ed130 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1407 microversion: 2.20 time: 0.147290 Oct 19 08:32:03.964709 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 585/1164] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:32:03 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:32:04.610001 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-f7263fc1-2d21-468b-be76-174f225515b1 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:32:04.610828 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-f7263fc1-2d21-468b-be76-174f225515b1 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:04.616545 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f7263fc1-2d21-468b-be76-174f225515b1 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:04.616985 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f7263fc1-2d21-468b-be76-174f225515b1 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:04.617735 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f7263fc1-2d21-468b-be76-174f225515b1 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:04.618163 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f7263fc1-2d21-468b-be76-174f225515b1 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:04.738393 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-f7263fc1-2d21-468b-be76-174f225515b1 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:04.746393 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-f7263fc1-2d21-468b-be76-174f225515b1 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1595 microversion: 2.1 time: 0.139725 Oct 19 08:32:04.747174 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 580/1165] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:32:04 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1595 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:32:04.982378 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-12dc5224-867e-4872-bd78-ab7e7271ec19 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:32:04.983003 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-12dc5224-867e-4872-bd78-ab7e7271ec19 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:04.988767 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-12dc5224-867e-4872-bd78-ab7e7271ec19 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:04.989203 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-12dc5224-867e-4872-bd78-ab7e7271ec19 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:04.989951 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-12dc5224-867e-4872-bd78-ab7e7271ec19 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:04.990370 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-12dc5224-867e-4872-bd78-ab7e7271ec19 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:05.184464 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-12dc5224-867e-4872-bd78-ab7e7271ec19 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:05.192593 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-12dc5224-867e-4872-bd78-ab7e7271ec19 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:05.194351 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-12dc5224-867e-4872-bd78-ab7e7271ec19 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:05.195461 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-12dc5224-867e-4872-bd78-ab7e7271ec19 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1407 microversion: 2.20 time: 0.216814 Oct 19 08:32:05.196012 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 586/1166] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:32:04 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:32:05.862430 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-fdb4615d-a0f1-49be-a2df-0b246d83afba req-052ea3d8-4731-455b-988f-8d5645c02d54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15322fb9-3685-4ce3-9f4d-9a407835f47a", "name": "network-vif-plugged", "status": "completed", "tag": "5a96c138-97d6-476d-b751-ac066e4a3cef"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:05.864617 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:32:05.864617 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:32:05.871664 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-fdb4615d-a0f1-49be-a2df-0b246d83afba req-052ea3d8-4731-455b-988f-8d5645c02d54 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:05.872118 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-fdb4615d-a0f1-49be-a2df-0b246d83afba req-052ea3d8-4731-455b-988f-8d5645c02d54 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:05.885364 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-fdb4615d-a0f1-49be-a2df-0b246d83afba req-052ea3d8-4731-455b-988f-8d5645c02d54 service nova] Creating event network-vif-plugged:5a96c138-97d6-476d-b751-ac066e4a3cef for instance 15322fb9-3685-4ce3-9f4d-9a407835f47a on hv-cinder-81398 Oct 19 08:32:05.890338 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-fdb4615d-a0f1-49be-a2df-0b246d83afba req-052ea3d8-4731-455b-988f-8d5645c02d54 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032013 Oct 19 08:32:05.891454 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 581/1167] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:32:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:32:06.213213 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-2690047d-c5a8-4ad3-a6c1-bf4ec00916a4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:32:06.213809 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-2690047d-c5a8-4ad3-a6c1-bf4ec00916a4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:06.219964 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2690047d-c5a8-4ad3-a6c1-bf4ec00916a4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:06.220577 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2690047d-c5a8-4ad3-a6c1-bf4ec00916a4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:06.221338 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2690047d-c5a8-4ad3-a6c1-bf4ec00916a4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:06.221761 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2690047d-c5a8-4ad3-a6c1-bf4ec00916a4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:06.453033 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-2690047d-c5a8-4ad3-a6c1-bf4ec00916a4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:06.463629 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-2690047d-c5a8-4ad3-a6c1-bf4ec00916a4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:06.465342 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-2690047d-c5a8-4ad3-a6c1-bf4ec00916a4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:06.466457 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-2690047d-c5a8-4ad3-a6c1-bf4ec00916a4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1407 microversion: 2.20 time: 0.256954 Oct 19 08:32:06.467090 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 587/1168] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:32:06 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:32:06.829023 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-3e66901c-5008-4e96-9ee8-5ed142ea121c req-509a9830-9541-423f-b6e4-225c9e1175a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7189072d-755e-4aa2-b182-d679f0abe991", "tag": "5b3bdd50-50bd-4849-bb58-8d9b2a088787"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:06.830521 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:32:06.830521 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:32:06.837628 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-3e66901c-5008-4e96-9ee8-5ed142ea121c req-509a9830-9541-423f-b6e4-225c9e1175a1 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:06.838064 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-3e66901c-5008-4e96-9ee8-5ed142ea121c req-509a9830-9541-423f-b6e4-225c9e1175a1 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:06.850068 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-3e66901c-5008-4e96-9ee8-5ed142ea121c req-509a9830-9541-423f-b6e4-225c9e1175a1 service nova] Creating event network-changed:5b3bdd50-50bd-4849-bb58-8d9b2a088787 for instance 7189072d-755e-4aa2-b182-d679f0abe991 on hv-cinder-81398 Oct 19 08:32:06.855559 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-3e66901c-5008-4e96-9ee8-5ed142ea121c req-509a9830-9541-423f-b6e4-225c9e1175a1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030596 Oct 19 08:32:06.856429 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 582/1169] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:32:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:32:07.484651 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ebf0ccff-8110-4b25-9005-1bd0ead924bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:32:07.485363 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ebf0ccff-8110-4b25-9005-1bd0ead924bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:07.492228 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ebf0ccff-8110-4b25-9005-1bd0ead924bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:07.492896 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ebf0ccff-8110-4b25-9005-1bd0ead924bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:07.493836 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ebf0ccff-8110-4b25-9005-1bd0ead924bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:07.494443 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ebf0ccff-8110-4b25-9005-1bd0ead924bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:07.631909 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ebf0ccff-8110-4b25-9005-1bd0ead924bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:07.640056 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ebf0ccff-8110-4b25-9005-1bd0ead924bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:07.642426 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ebf0ccff-8110-4b25-9005-1bd0ead924bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:07.643957 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ebf0ccff-8110-4b25-9005-1bd0ead924bb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1407 microversion: 2.20 time: 0.163084 Oct 19 08:32:07.644506 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 588/1170] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:32:07 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:32:07.869635 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-fe5ab9ed-46b9-41ea-ab32-13ca43b4accf tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1985919572"}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:07.871306 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-fe5ab9ed-46b9-41ea-ab32-13ca43b4accf tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:07.877898 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fe5ab9ed-46b9-41ea-ab32-13ca43b4accf tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:07.879163 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fe5ab9ed-46b9-41ea-ab32-13ca43b4accf tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:07.880017 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fe5ab9ed-46b9-41ea-ab32-13ca43b4accf tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:07.880701 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fe5ab9ed-46b9-41ea-ab32-13ca43b4accf tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:08.008020 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.network.security_group_api [None req-fe5ab9ed-46b9-41ea-ab32-13ca43b4accf tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Adding security group b94be8c3-234b-4cdf-8578-3672b7eda7b1 to port 5b3bdd50-50bd-4849-bb58-8d9b2a088787 Oct 19 08:32:08.353860 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-fe5ab9ed-46b9-41ea-ab32-13ca43b4accf tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "POST /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991/action" status: 202 len: 0 microversion: 2.1 time: 0.489735 Oct 19 08:32:08.355111 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 583/1171] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:32:07 2021] POST /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:32:08.363524 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-49d91848-467d-408c-baf3-9b6a0f9e9185 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:32:08.364135 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-49d91848-467d-408c-baf3-9b6a0f9e9185 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:08.370210 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-49d91848-467d-408c-baf3-9b6a0f9e9185 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:08.371241 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-49d91848-467d-408c-baf3-9b6a0f9e9185 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:08.372474 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-49d91848-467d-408c-baf3-9b6a0f9e9185 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:08.373121 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-49d91848-467d-408c-baf3-9b6a0f9e9185 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:08.516443 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-49d91848-467d-408c-baf3-9b6a0f9e9185 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:08.524752 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-49d91848-467d-408c-baf3-9b6a0f9e9185 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1761 microversion: 2.1 time: 0.165448 Oct 19 08:32:08.525736 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 589/1172] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:32:08 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1761 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:32:08.661657 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-9b2be452-9c6d-4178-ab83-23856c4666a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:32:08.662568 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-9b2be452-9c6d-4178-ab83-23856c4666a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:08.668767 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9b2be452-9c6d-4178-ab83-23856c4666a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:08.669205 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9b2be452-9c6d-4178-ab83-23856c4666a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:08.669955 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9b2be452-9c6d-4178-ab83-23856c4666a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:08.670379 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9b2be452-9c6d-4178-ab83-23856c4666a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:08.788513 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-9b2be452-9c6d-4178-ab83-23856c4666a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:08.796088 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-9b2be452-9c6d-4178-ab83-23856c4666a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:08.798118 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-9b2be452-9c6d-4178-ab83-23856c4666a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:08.799614 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-9b2be452-9c6d-4178-ab83-23856c4666a1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1599 microversion: 2.20 time: 0.141912 Oct 19 08:32:08.800163 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 584/1173] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:32:08 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1599 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:32:08.816834 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-cfb56c80-2c9b-4e2e-bd66-69d1aee66596 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:32:08.817313 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-cfb56c80-2c9b-4e2e-bd66-69d1aee66596 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:08.822968 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cfb56c80-2c9b-4e2e-bd66-69d1aee66596 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:08.823402 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cfb56c80-2c9b-4e2e-bd66-69d1aee66596 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:08.824491 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cfb56c80-2c9b-4e2e-bd66-69d1aee66596 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:08.824813 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cfb56c80-2c9b-4e2e-bd66-69d1aee66596 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:08.875530 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-bd9780cc-eda3-4dd7-8f6e-3269ae54bc4e req-b728a23e-99bc-4e97-a47f-37376d6f1c91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7189072d-755e-4aa2-b182-d679f0abe991", "tag": "5b3bdd50-50bd-4849-bb58-8d9b2a088787"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:08.878134 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:32:08.878134 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:32:08.885238 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-bd9780cc-eda3-4dd7-8f6e-3269ae54bc4e req-b728a23e-99bc-4e97-a47f-37376d6f1c91 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:08.885804 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-bd9780cc-eda3-4dd7-8f6e-3269ae54bc4e req-b728a23e-99bc-4e97-a47f-37376d6f1c91 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:08.897511 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-bd9780cc-eda3-4dd7-8f6e-3269ae54bc4e req-b728a23e-99bc-4e97-a47f-37376d6f1c91 service nova] Creating event network-changed:5b3bdd50-50bd-4849-bb58-8d9b2a088787 for instance 7189072d-755e-4aa2-b182-d679f0abe991 on hv-cinder-81398 Oct 19 08:32:08.902339 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-bd9780cc-eda3-4dd7-8f6e-3269ae54bc4e req-b728a23e-99bc-4e97-a47f-37376d6f1c91 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030397 Oct 19 08:32:08.903129 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 585/1174] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:32:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:32:08.912578 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-cfb56c80-2c9b-4e2e-bd66-69d1aee66596 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.099825 Oct 19 08:32:08.913226 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 590/1175] 10.222.0.26 () {60 vars in 1315 bytes} [Tue Oct 19 08:32:08 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:32:10.454455 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-45e07c9f-5948-445f-8f1a-51db585a1da1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:10.455556 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-45e07c9f-5948-445f-8f1a-51db585a1da1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:10.461665 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-45e07c9f-5948-445f-8f1a-51db585a1da1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:10.462112 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-45e07c9f-5948-445f-8f1a-51db585a1da1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:10.462911 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-45e07c9f-5948-445f-8f1a-51db585a1da1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:10.463342 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-45e07c9f-5948-445f-8f1a-51db585a1da1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:10.525569 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-45e07c9f-5948-445f-8f1a-51db585a1da1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 14 microversion: 2.20 time: 0.074996 Oct 19 08:32:10.528828 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 586/1176] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:10 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:32:10.923997 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-77dcf001-4a9a-4f86-bd00-ce19123e14fc req-dfa0bd3f-9fe2-4e40-a2af-012c95996a0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15322fb9-3685-4ce3-9f4d-9a407835f47a", "tag": "5a96c138-97d6-476d-b751-ac066e4a3cef"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:10.925448 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:32:10.925448 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:32:10.932035 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-77dcf001-4a9a-4f86-bd00-ce19123e14fc req-dfa0bd3f-9fe2-4e40-a2af-012c95996a0f service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:10.932463 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-77dcf001-4a9a-4f86-bd00-ce19123e14fc req-dfa0bd3f-9fe2-4e40-a2af-012c95996a0f service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:10.943017 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-77dcf001-4a9a-4f86-bd00-ce19123e14fc req-dfa0bd3f-9fe2-4e40-a2af-012c95996a0f service nova] Creating event network-changed:5a96c138-97d6-476d-b751-ac066e4a3cef for instance 15322fb9-3685-4ce3-9f4d-9a407835f47a on hv-cinder-81398 Oct 19 08:32:10.948068 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-77dcf001-4a9a-4f86-bd00-ce19123e14fc req-dfa0bd3f-9fe2-4e40-a2af-012c95996a0f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028295 Oct 19 08:32:10.948678 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 591/1177] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:32:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:32:11.537171 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-454dad79-36cf-4549-975e-958363754f61 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:11.538162 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-454dad79-36cf-4549-975e-958363754f61 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:11.544613 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-454dad79-36cf-4549-975e-958363754f61 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:11.545056 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-454dad79-36cf-4549-975e-958363754f61 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:11.545806 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-454dad79-36cf-4549-975e-958363754f61 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:11.546230 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-454dad79-36cf-4549-975e-958363754f61 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:11.614016 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-454dad79-36cf-4549-975e-958363754f61 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 14 microversion: 2.20 time: 0.080836 Oct 19 08:32:11.614656 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 587/1178] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:11 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:32:12.625318 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-516b0207-57d6-4424-b8b6-2b62efd1de25 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:12.626525 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-516b0207-57d6-4424-b8b6-2b62efd1de25 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:12.632568 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-516b0207-57d6-4424-b8b6-2b62efd1de25 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:12.633007 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-516b0207-57d6-4424-b8b6-2b62efd1de25 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:12.633762 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-516b0207-57d6-4424-b8b6-2b62efd1de25 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:12.634188 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-516b0207-57d6-4424-b8b6-2b62efd1de25 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:12.712920 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-516b0207-57d6-4424-b8b6-2b62efd1de25 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 14 microversion: 2.20 time: 0.091628 Oct 19 08:32:12.713511 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 592/1179] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:12 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:32:13.724843 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-af46e8eb-434d-4063-9c00-1fa7ad187408 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:13.725752 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-af46e8eb-434d-4063-9c00-1fa7ad187408 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:13.732188 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-af46e8eb-434d-4063-9c00-1fa7ad187408 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:13.732630 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-af46e8eb-434d-4063-9c00-1fa7ad187408 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:13.733383 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-af46e8eb-434d-4063-9c00-1fa7ad187408 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:13.733809 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-af46e8eb-434d-4063-9c00-1fa7ad187408 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:13.797258 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-af46e8eb-434d-4063-9c00-1fa7ad187408 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 14 microversion: 2.20 time: 0.076536 Oct 19 08:32:13.798555 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 588/1180] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:13 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:32:14.809255 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-784f171c-7c71-4904-bb29-4bd809b9f45b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:14.810183 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-784f171c-7c71-4904-bb29-4bd809b9f45b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:14.817179 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-784f171c-7c71-4904-bb29-4bd809b9f45b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:14.817643 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-784f171c-7c71-4904-bb29-4bd809b9f45b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:14.818399 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-784f171c-7c71-4904-bb29-4bd809b9f45b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:14.818849 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-784f171c-7c71-4904-bb29-4bd809b9f45b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:14.880977 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-784f171c-7c71-4904-bb29-4bd809b9f45b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 14 microversion: 2.20 time: 0.075670 Oct 19 08:32:14.881567 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 593/1181] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:14 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:32:15.892675 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-874f5783-7a0c-49cb-9808-8574303a5139 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:15.893669 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-874f5783-7a0c-49cb-9808-8574303a5139 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:15.900161 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-874f5783-7a0c-49cb-9808-8574303a5139 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:15.900607 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-874f5783-7a0c-49cb-9808-8574303a5139 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:15.901368 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-874f5783-7a0c-49cb-9808-8574303a5139 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:15.901912 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-874f5783-7a0c-49cb-9808-8574303a5139 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:15.963385 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-874f5783-7a0c-49cb-9808-8574303a5139 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 14 microversion: 2.20 time: 0.074741 Oct 19 08:32:15.964170 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 589/1182] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:15 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:32:16.974718 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-d7f964c2-b9e1-4d83-a616-03814288c2dd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:16.975705 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-d7f964c2-b9e1-4d83-a616-03814288c2dd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:16.982111 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d7f964c2-b9e1-4d83-a616-03814288c2dd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:16.982585 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d7f964c2-b9e1-4d83-a616-03814288c2dd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:16.983334 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d7f964c2-b9e1-4d83-a616-03814288c2dd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:16.983761 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d7f964c2-b9e1-4d83-a616-03814288c2dd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:17.043043 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-d7f964c2-b9e1-4d83-a616-03814288c2dd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 14 microversion: 2.20 time: 0.072264 Oct 19 08:32:17.043627 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 594/1183] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:16 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:32:18.054564 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-1bf8e797-aec9-4f14-9238-468bad2a54d9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:18.055495 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-1bf8e797-aec9-4f14-9238-468bad2a54d9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:18.061910 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1bf8e797-aec9-4f14-9238-468bad2a54d9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:18.062353 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1bf8e797-aec9-4f14-9238-468bad2a54d9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:18.063207 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1bf8e797-aec9-4f14-9238-468bad2a54d9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:18.063838 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1bf8e797-aec9-4f14-9238-468bad2a54d9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:18.125950 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-1bf8e797-aec9-4f14-9238-468bad2a54d9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 14 microversion: 2.20 time: 0.075414 Oct 19 08:32:18.126603 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 590/1184] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:18 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:32:19.138348 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-6bfd5ba6-e807-42d9-ba37-5d5b9f02afac tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:19.139358 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-6bfd5ba6-e807-42d9-ba37-5d5b9f02afac tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:19.149454 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6bfd5ba6-e807-42d9-ba37-5d5b9f02afac tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:19.149948 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6bfd5ba6-e807-42d9-ba37-5d5b9f02afac tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:19.150813 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6bfd5ba6-e807-42d9-ba37-5d5b9f02afac tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:19.151246 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6bfd5ba6-e807-42d9-ba37-5d5b9f02afac tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:19.219022 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-6bfd5ba6-e807-42d9-ba37-5d5b9f02afac tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 14 microversion: 2.20 time: 0.084503 Oct 19 08:32:19.220574 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 595/1185] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:19 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:32:20.231322 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-0b86f451-b995-4a76-ab64-bbc5cc15d219 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:20.232312 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-0b86f451-b995-4a76-ab64-bbc5cc15d219 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:20.238847 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0b86f451-b995-4a76-ab64-bbc5cc15d219 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:20.239291 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0b86f451-b995-4a76-ab64-bbc5cc15d219 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:20.240056 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0b86f451-b995-4a76-ab64-bbc5cc15d219 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:20.240486 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0b86f451-b995-4a76-ab64-bbc5cc15d219 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:20.306736 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-0b86f451-b995-4a76-ab64-bbc5cc15d219 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 14 microversion: 2.20 time: 0.079275 Oct 19 08:32:20.307355 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 591/1186] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:20 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:32:21.318311 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-7b125c3c-1b97-45d3-8e6b-100fb4087ff5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:21.319340 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-7b125c3c-1b97-45d3-8e6b-100fb4087ff5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:21.325858 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7b125c3c-1b97-45d3-8e6b-100fb4087ff5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:21.326300 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7b125c3c-1b97-45d3-8e6b-100fb4087ff5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:21.327092 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7b125c3c-1b97-45d3-8e6b-100fb4087ff5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:21.327515 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7b125c3c-1b97-45d3-8e6b-100fb4087ff5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:21.400145 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-7b125c3c-1b97-45d3-8e6b-100fb4087ff5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 14 microversion: 2.20 time: 0.085728 Oct 19 08:32:21.400811 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 596/1187] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:21 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:32:22.411651 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8a4b4bec-f5a0-485b-8124-7ecb1c5c3692 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:22.412628 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-8a4b4bec-f5a0-485b-8124-7ecb1c5c3692 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:22.419086 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8a4b4bec-f5a0-485b-8124-7ecb1c5c3692 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:22.419524 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8a4b4bec-f5a0-485b-8124-7ecb1c5c3692 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:22.420273 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8a4b4bec-f5a0-485b-8124-7ecb1c5c3692 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:22.420694 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8a4b4bec-f5a0-485b-8124-7ecb1c5c3692 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:22.481358 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-8a4b4bec-f5a0-485b-8124-7ecb1c5c3692 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 14 microversion: 2.20 time: 0.074083 Oct 19 08:32:22.482000 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 592/1188] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:22 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:32:23.492574 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-2bc6332b-03ca-4460-97de-2ad864f404f9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:23.493578 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-2bc6332b-03ca-4460-97de-2ad864f404f9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:23.500023 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2bc6332b-03ca-4460-97de-2ad864f404f9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:23.500972 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2bc6332b-03ca-4460-97de-2ad864f404f9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:23.501790 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2bc6332b-03ca-4460-97de-2ad864f404f9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:23.502204 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2bc6332b-03ca-4460-97de-2ad864f404f9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:23.588548 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-2bc6332b-03ca-4460-97de-2ad864f404f9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 12548 microversion: 2.20 time: 0.099820 Oct 19 08:32:23.589185 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 597/1189] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:23 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 12548 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:32:24.600940 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-15923941-572e-499e-b273-dd54e1cd2ebb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:24.601925 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-15923941-572e-499e-b273-dd54e1cd2ebb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:24.608326 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-15923941-572e-499e-b273-dd54e1cd2ebb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:24.608770 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-15923941-572e-499e-b273-dd54e1cd2ebb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:24.609550 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-15923941-572e-499e-b273-dd54e1cd2ebb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:24.609977 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-15923941-572e-499e-b273-dd54e1cd2ebb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:24.693071 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-15923941-572e-499e-b273-dd54e1cd2ebb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 18398 microversion: 2.20 time: 0.096045 Oct 19 08:32:24.693606 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 593/1190] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:24 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 18398 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:32:25.704869 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-6de2a563-e582-4ed3-b347-54d24540f430 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:25.706358 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-6de2a563-e582-4ed3-b347-54d24540f430 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:25.712753 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6de2a563-e582-4ed3-b347-54d24540f430 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:25.713190 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6de2a563-e582-4ed3-b347-54d24540f430 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:25.713946 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6de2a563-e582-4ed3-b347-54d24540f430 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:25.714370 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6de2a563-e582-4ed3-b347-54d24540f430 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:25.784260 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-6de2a563-e582-4ed3-b347-54d24540f430 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 19133 microversion: 2.20 time: 0.083397 Oct 19 08:32:25.784897 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 598/1191] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:25 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 19133 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:32:26.795605 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-7a8a19f5-b9b7-4a99-9754-09487da6985f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:26.796638 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-7a8a19f5-b9b7-4a99-9754-09487da6985f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:26.803405 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7a8a19f5-b9b7-4a99-9754-09487da6985f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:26.803841 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7a8a19f5-b9b7-4a99-9754-09487da6985f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:26.804583 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7a8a19f5-b9b7-4a99-9754-09487da6985f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:26.805005 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7a8a19f5-b9b7-4a99-9754-09487da6985f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:26.886375 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-7a8a19f5-b9b7-4a99-9754-09487da6985f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 21165 microversion: 2.20 time: 0.094775 Oct 19 08:32:26.887293 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 594/1192] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:26 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 21165 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:32:27.897722 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-09d8e32d-c3f9-4420-8d51-2e2bb1553f68 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:27.898723 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-09d8e32d-c3f9-4420-8d51-2e2bb1553f68 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:27.905590 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-09d8e32d-c3f9-4420-8d51-2e2bb1553f68 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:27.906033 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-09d8e32d-c3f9-4420-8d51-2e2bb1553f68 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:27.906814 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-09d8e32d-c3f9-4420-8d51-2e2bb1553f68 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:27.907238 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-09d8e32d-c3f9-4420-8d51-2e2bb1553f68 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:27.983678 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-09d8e32d-c3f9-4420-8d51-2e2bb1553f68 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 22979 microversion: 2.20 time: 0.089882 Oct 19 08:32:27.984497 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 599/1193] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:27 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 22979 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:32:28.996214 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-24e2bd10-6b82-497b-959e-7d7e5e1a087a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:28.997226 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-24e2bd10-6b82-497b-959e-7d7e5e1a087a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:29.004461 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-24e2bd10-6b82-497b-959e-7d7e5e1a087a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:29.004901 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-24e2bd10-6b82-497b-959e-7d7e5e1a087a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:29.005655 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-24e2bd10-6b82-497b-959e-7d7e5e1a087a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:29.006336 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-24e2bd10-6b82-497b-959e-7d7e5e1a087a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:29.084627 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-24e2bd10-6b82-497b-959e-7d7e5e1a087a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 23802 microversion: 2.20 time: 0.092352 Oct 19 08:32:29.085239 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 595/1194] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:28 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 23802 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:32:30.096601 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-5c703ac7-005c-440d-8a35-c79037603516 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:30.097592 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-5c703ac7-005c-440d-8a35-c79037603516 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:30.104006 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5c703ac7-005c-440d-8a35-c79037603516 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:30.104445 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5c703ac7-005c-440d-8a35-c79037603516 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:30.105226 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5c703ac7-005c-440d-8a35-c79037603516 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:30.105653 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5c703ac7-005c-440d-8a35-c79037603516 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:30.185338 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-5c703ac7-005c-440d-8a35-c79037603516 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 25039 microversion: 2.20 time: 0.092743 Oct 19 08:32:30.185944 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 600/1195] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:30 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 25039 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:32:31.197315 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-e0c4e237-dfd3-4c6a-aa74-149a16eb4998 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:31.198297 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-e0c4e237-dfd3-4c6a-aa74-149a16eb4998 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:31.204636 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e0c4e237-dfd3-4c6a-aa74-149a16eb4998 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:31.205088 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e0c4e237-dfd3-4c6a-aa74-149a16eb4998 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:31.205812 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e0c4e237-dfd3-4c6a-aa74-149a16eb4998 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:31.206229 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e0c4e237-dfd3-4c6a-aa74-149a16eb4998 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:31.279364 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-e0c4e237-dfd3-4c6a-aa74-149a16eb4998 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 26293 microversion: 2.20 time: 0.086018 Oct 19 08:32:31.279971 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 596/1196] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:31 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 26293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:32:32.291919 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-21573e44-ea05-459a-bc0d-bc1789890800 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:32.292930 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-21573e44-ea05-459a-bc0d-bc1789890800 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:32.300032 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-21573e44-ea05-459a-bc0d-bc1789890800 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:32.300475 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-21573e44-ea05-459a-bc0d-bc1789890800 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:32.301228 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-21573e44-ea05-459a-bc0d-bc1789890800 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:32.301712 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-21573e44-ea05-459a-bc0d-bc1789890800 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:32.381935 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-21573e44-ea05-459a-bc0d-bc1789890800 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 27362 microversion: 2.20 time: 0.093828 Oct 19 08:32:32.382620 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 601/1197] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:32 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 27362 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:32:33.394102 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-982f2f55-5b68-45da-b4c6-ebeb691608ab tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:33.395113 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-982f2f55-5b68-45da-b4c6-ebeb691608ab tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:33.401650 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-982f2f55-5b68-45da-b4c6-ebeb691608ab tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:33.402088 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-982f2f55-5b68-45da-b4c6-ebeb691608ab tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:33.402936 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-982f2f55-5b68-45da-b4c6-ebeb691608ab tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:33.403362 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-982f2f55-5b68-45da-b4c6-ebeb691608ab tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:33.481676 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-982f2f55-5b68-45da-b4c6-ebeb691608ab tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 27743 microversion: 2.20 time: 0.091745 Oct 19 08:32:33.482272 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 597/1198] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:33 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 27743 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:32:34.494253 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c9abbdc3-cf27-4159-b4f8-c45da0735f9c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:34.495270 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c9abbdc3-cf27-4159-b4f8-c45da0735f9c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:34.501612 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c9abbdc3-cf27-4159-b4f8-c45da0735f9c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:34.502707 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c9abbdc3-cf27-4159-b4f8-c45da0735f9c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:34.503541 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c9abbdc3-cf27-4159-b4f8-c45da0735f9c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:34.503967 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c9abbdc3-cf27-4159-b4f8-c45da0735f9c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:34.588497 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c9abbdc3-cf27-4159-b4f8-c45da0735f9c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28055 microversion: 2.20 time: 0.098116 Oct 19 08:32:34.589119 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 602/1199] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:34 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28055 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:32:35.600481 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-4f83ff2a-422d-40af-853f-62cbb0300705 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:35.601498 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-4f83ff2a-422d-40af-853f-62cbb0300705 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:35.608119 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4f83ff2a-422d-40af-853f-62cbb0300705 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:35.608563 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4f83ff2a-422d-40af-853f-62cbb0300705 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:35.609419 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4f83ff2a-422d-40af-853f-62cbb0300705 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:35.609902 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4f83ff2a-422d-40af-853f-62cbb0300705 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:35.685101 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-4f83ff2a-422d-40af-853f-62cbb0300705 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28172 microversion: 2.20 time: 0.088530 Oct 19 08:32:35.688853 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 598/1200] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:35 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28172 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:32:35.690402 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3d0fad85-f074-48d3-84ca-ba77a2630e20 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:32:35.691695 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3d0fad85-f074-48d3-84ca-ba77a2630e20 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:35.698394 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3d0fad85-f074-48d3-84ca-ba77a2630e20 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:35.698865 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3d0fad85-f074-48d3-84ca-ba77a2630e20 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:35.699613 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3d0fad85-f074-48d3-84ca-ba77a2630e20 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:35.700031 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3d0fad85-f074-48d3-84ca-ba77a2630e20 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:35.727874 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3d0fad85-f074-48d3-84ca-ba77a2630e20 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042094 Oct 19 08:32:35.728413 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 603/1201] 10.222.0.26 () {58 vars in 1301 bytes} [Tue Oct 19 08:32:35 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 08:32:35.784560 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-cbbea2be-6281-438b-bc83-74ad37337fff tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:32:35.785128 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-cbbea2be-6281-438b-bc83-74ad37337fff tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:35.791579 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cbbea2be-6281-438b-bc83-74ad37337fff tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:35.792016 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cbbea2be-6281-438b-bc83-74ad37337fff tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:35.792758 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cbbea2be-6281-438b-bc83-74ad37337fff tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:35.793180 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cbbea2be-6281-438b-bc83-74ad37337fff tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:35.818105 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-cbbea2be-6281-438b-bc83-74ad37337fff tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Going to try to terminate instance {{(pid=114105) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 19 08:32:35.888863 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-cbbea2be-6281-438b-bc83-74ad37337fff tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "DELETE /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 204 len: 0 microversion: 2.1 time: 0.108404 Oct 19 08:32:35.889441 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 599/1202] 10.222.0.26 () {58 vars in 1238 bytes} [Tue Oct 19 08:32:35 2021] DELETE /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 08:32:35.897748 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-9467b34d-a05f-4843-b9a5-f3b6fc9aba9d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:32:35.898355 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-9467b34d-a05f-4843-b9a5-f3b6fc9aba9d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:35.904241 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9467b34d-a05f-4843-b9a5-f3b6fc9aba9d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:35.904682 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9467b34d-a05f-4843-b9a5-f3b6fc9aba9d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:35.905428 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9467b34d-a05f-4843-b9a5-f3b6fc9aba9d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:35.905853 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9467b34d-a05f-4843-b9a5-f3b6fc9aba9d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:36.025543 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-9467b34d-a05f-4843-b9a5-f3b6fc9aba9d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:36.032684 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-9467b34d-a05f-4843-b9a5-f3b6fc9aba9d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1672 microversion: 2.1 time: 0.138606 Oct 19 08:32:36.033285 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 604/1203] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:32:35 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1672 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:32:36.697100 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-b02502a5-d45d-431b-bc25-25a90f31cce2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:36.698010 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-b02502a5-d45d-431b-bc25-25a90f31cce2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:36.703668 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b02502a5-d45d-431b-bc25-25a90f31cce2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:36.704112 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b02502a5-d45d-431b-bc25-25a90f31cce2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:36.704870 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b02502a5-d45d-431b-bc25-25a90f31cce2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:36.706087 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b02502a5-d45d-431b-bc25-25a90f31cce2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:36.773528 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-b02502a5-d45d-431b-bc25-25a90f31cce2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28172 microversion: 2.20 time: 0.080476 Oct 19 08:32:36.774139 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 600/1204] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:36 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28172 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:32:37.050237 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-358188f8-d384-4477-9945-3a7ffb5c7e7c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:32:37.050847 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-358188f8-d384-4477-9945-3a7ffb5c7e7c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:37.056891 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-358188f8-d384-4477-9945-3a7ffb5c7e7c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:37.057355 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-358188f8-d384-4477-9945-3a7ffb5c7e7c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:37.058098 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-358188f8-d384-4477-9945-3a7ffb5c7e7c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:37.058541 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-358188f8-d384-4477-9945-3a7ffb5c7e7c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:37.175815 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-358188f8-d384-4477-9945-3a7ffb5c7e7c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:37.183032 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-358188f8-d384-4477-9945-3a7ffb5c7e7c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1672 microversion: 2.1 time: 0.136803 Oct 19 08:32:37.183586 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 605/1205] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:32:37 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1672 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:32:37.785733 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-b743c90c-8dd4-4505-99d3-48cf60d9cdcd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:37.786765 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-b743c90c-8dd4-4505-99d3-48cf60d9cdcd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:37.793291 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b743c90c-8dd4-4505-99d3-48cf60d9cdcd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:37.793740 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b743c90c-8dd4-4505-99d3-48cf60d9cdcd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:37.794746 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b743c90c-8dd4-4505-99d3-48cf60d9cdcd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:37.795354 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b743c90c-8dd4-4505-99d3-48cf60d9cdcd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:37.855885 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-b743c90c-8dd4-4505-99d3-48cf60d9cdcd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28172 microversion: 2.20 time: 0.074197 Oct 19 08:32:37.859687 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 601/1206] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:37 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28172 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:32:38.101379 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-753a3e0b-3105-43c5-9011-6e74dafee62b req-a12aaaeb-5ddd-47d8-90be-d502c26a87fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b1ba9b-8d31-4658-9d03-3be46d4f7504", "name": "network-vif-deleted", "tag": "dd3a33e9-9f8d-4c39-a3b8-617d066c9a63"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:38.103608 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:32:38.103608 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:32:38.114242 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-753a3e0b-3105-43c5-9011-6e74dafee62b req-a12aaaeb-5ddd-47d8-90be-d502c26a87fe service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:38.114707 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-753a3e0b-3105-43c5-9011-6e74dafee62b req-a12aaaeb-5ddd-47d8-90be-d502c26a87fe service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:38.126402 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-753a3e0b-3105-43c5-9011-6e74dafee62b req-a12aaaeb-5ddd-47d8-90be-d502c26a87fe service nova] Creating event network-vif-deleted:dd3a33e9-9f8d-4c39-a3b8-617d066c9a63 for instance 30b1ba9b-8d31-4658-9d03-3be46d4f7504 on hv-cinder-81398 Oct 19 08:32:38.132112 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-753a3e0b-3105-43c5-9011-6e74dafee62b req-a12aaaeb-5ddd-47d8-90be-d502c26a87fe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034673 Oct 19 08:32:38.132709 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 606/1207] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:32:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:32:38.201679 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-ede6d9ea-f186-4df5-90c0-86f9a3c5f96e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:32:38.202318 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-ede6d9ea-f186-4df5-90c0-86f9a3c5f96e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:38.218149 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ede6d9ea-f186-4df5-90c0-86f9a3c5f96e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:38.218624 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ede6d9ea-f186-4df5-90c0-86f9a3c5f96e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:38.219416 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ede6d9ea-f186-4df5-90c0-86f9a3c5f96e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:38.219880 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ede6d9ea-f186-4df5-90c0-86f9a3c5f96e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:38.255521 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ede6d9ea-f186-4df5-90c0-86f9a3c5f96e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:38.255962 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ede6d9ea-f186-4df5-90c0-86f9a3c5f96e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:38.256412 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.objects.instance [None req-ede6d9ea-f186-4df5-90c0-86f9a3c5f96e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lazy-loading 'fault' on Instance uuid 30b1ba9b-8d31-4658-9d03-3be46d4f7504 {{(pid=114105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 19 08:32:38.304312 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-ede6d9ea-f186-4df5-90c0-86f9a3c5f96e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:38.312492 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-ede6d9ea-f186-4df5-90c0-86f9a3c5f96e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 200 len: 1327 microversion: 2.1 time: 0.115327 Oct 19 08:32:38.313058 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 602/1208] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:32:38 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 1327 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:32:38.867400 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-2c614a97-3456-49bd-b8a8-588496a83196 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:38.868392 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-2c614a97-3456-49bd-b8a8-588496a83196 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:38.874276 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2c614a97-3456-49bd-b8a8-588496a83196 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:38.874767 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2c614a97-3456-49bd-b8a8-588496a83196 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:38.875533 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2c614a97-3456-49bd-b8a8-588496a83196 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:38.875971 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2c614a97-3456-49bd-b8a8-588496a83196 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:38.941049 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-2c614a97-3456-49bd-b8a8-588496a83196 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28172 microversion: 2.20 time: 0.077578 Oct 19 08:32:38.941703 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 607/1209] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:38 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28172 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:32:39.329844 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d1e96b21-8972-4a1e-ae00-84356bbb42fc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:32:39.331191 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-d1e96b21-8972-4a1e-ae00-84356bbb42fc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:39.337589 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d1e96b21-8972-4a1e-ae00-84356bbb42fc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:39.338043 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d1e96b21-8972-4a1e-ae00-84356bbb42fc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:39.338848 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d1e96b21-8972-4a1e-ae00-84356bbb42fc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:39.339287 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d1e96b21-8972-4a1e-ae00-84356bbb42fc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:39.352661 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.wsgi [None req-d1e96b21-8972-4a1e-ae00-84356bbb42fc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] HTTP exception thrown: Instance 30b1ba9b-8d31-4658-9d03-3be46d4f7504 could not be found. Oct 19 08:32:39.353241 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d1e96b21-8972-4a1e-ae00-84356bbb42fc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Returning 404 to user: Instance 30b1ba9b-8d31-4658-9d03-3be46d4f7504 could not be found. {{(pid=114105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:32:39.354040 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-d1e96b21-8972-4a1e-ae00-84356bbb42fc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 404 len: 111 microversion: 2.1 time: 0.027987 Oct 19 08:32:39.354638 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 603/1210] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:32:39 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:32:39.363106 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-bd663945-f754-412b-a650-3aa45c4157a9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '.version_select at 0x7fcadcfdff70>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:32:39.381071 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-bd663945-f754-412b-a650-3aa45c4157a9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-819625590" status: 202 len: 0 microversion: 2.1 time: 0.021852 Oct 19 08:32:39.381552 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 608/1211] 10.222.0.26 () {58 vars in 1217 bytes} [Tue Oct 19 08:32:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-819625590 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:32:39.953099 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-0ae6722c-9bcc-425e-9834-1e096385b776 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:39.954046 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-0ae6722c-9bcc-425e-9834-1e096385b776 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:39.960340 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0ae6722c-9bcc-425e-9834-1e096385b776 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:39.960779 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0ae6722c-9bcc-425e-9834-1e096385b776 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:39.961546 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0ae6722c-9bcc-425e-9834-1e096385b776 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:39.961967 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0ae6722c-9bcc-425e-9834-1e096385b776 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:40.027901 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-0ae6722c-9bcc-425e-9834-1e096385b776 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28172 microversion: 2.20 time: 0.078492 Oct 19 08:32:40.028545 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 604/1212] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:39 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28172 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:32:40.302380 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ebbb7d8c-4c96-4e5e-a788-99162c8bcb98 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'create', calling method: .version_select at 0x7fcadd9a5af0>, body: {"keypair": {"name": "tempest-keypair-1123495117"}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:40.319942 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-ebbb7d8c-4c96-4e5e-a788-99162c8bcb98 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Getting quotas for project d039e505af3b42a3afdc9ac76295e901. Resources: {'key_pairs'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:32:40.323614 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-ebbb7d8c-4c96-4e5e-a788-99162c8bcb98 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Getting quotas for user 3b8dea90b58a49b391bec5f0a04acb71 and project d039e505af3b42a3afdc9ac76295e901. Resources: {'key_pairs'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:32:40.618824 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-ebbb7d8c-4c96-4e5e-a788-99162c8bcb98 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Getting quotas for project d039e505af3b42a3afdc9ac76295e901. Resources: {'key_pairs'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:32:40.622450 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-ebbb7d8c-4c96-4e5e-a788-99162c8bcb98 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Getting quotas for user 3b8dea90b58a49b391bec5f0a04acb71 and project d039e505af3b42a3afdc9ac76295e901. Resources: {'key_pairs'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:32:40.635661 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ebbb7d8c-4c96-4e5e-a788-99162c8bcb98 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.337539 Oct 19 08:32:40.636245 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 609/1213] 10.222.0.26 () {60 vars in 1157 bytes} [Tue Oct 19 08:32:40 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:32:41.040510 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d086fdd2-cdf6-498e-bdce-e05f7c8b9ae0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:41.041497 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-d086fdd2-cdf6-498e-bdce-e05f7c8b9ae0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:41.047824 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d086fdd2-cdf6-498e-bdce-e05f7c8b9ae0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:41.048264 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d086fdd2-cdf6-498e-bdce-e05f7c8b9ae0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:41.049629 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d086fdd2-cdf6-498e-bdce-e05f7c8b9ae0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:41.050055 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d086fdd2-cdf6-498e-bdce-e05f7c8b9ae0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:41.110145 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-d086fdd2-cdf6-498e-bdce-e05f7c8b9ae0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28172 microversion: 2.20 time: 0.073492 Oct 19 08:32:41.111125 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 605/1214] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:41 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28172 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:32:41.892754 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-2c1e8a8f-5f06-4bd6-956b-96f80cdd2363 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-139843581", "imageRef": "9102a998-a580-4b4e-b6a1-3172273dd66d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ed1909e-af6f-44e6-9da9-5c8feb78bdd0"}], "security_groups": [{"name": "tempest-securitygroup--17749671"}], "key_name": "tempest-keypair-1123495117", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:41.982115 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.network.neutron [None req-2c1e8a8f-5f06-4bd6-956b-96f80cdd2363 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] validate_networks() for [('5ed1909e-af6f-44e6-9da9-5c8feb78bdd0', None, None, None, None, None)] {{(pid=114106) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 19 08:32:42.121647 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d96ec73b-ae19-4480-846e-f975c0bf5698 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:42.122799 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-d96ec73b-ae19-4480-846e-f975c0bf5698 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:42.130056 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d96ec73b-ae19-4480-846e-f975c0bf5698 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:42.130522 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d96ec73b-ae19-4480-846e-f975c0bf5698 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:42.131298 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d96ec73b-ae19-4480-846e-f975c0bf5698 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:42.131722 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d96ec73b-ae19-4480-846e-f975c0bf5698 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:42.192394 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-d96ec73b-ae19-4480-846e-f975c0bf5698 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28172 microversion: 2.20 time: 0.074618 Oct 19 08:32:42.196680 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 606/1215] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:42 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28172 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:32:42.347956 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-2c1e8a8f-5f06-4bd6-956b-96f80cdd2363 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Flavor limits 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 08:32:42.348403 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-2c1e8a8f-5f06-4bd6-956b-96f80cdd2363 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Image limits 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 08:32:42.348870 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-2c1e8a8f-5f06-4bd6-956b-96f80cdd2363 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Flavor pref 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 08:32:42.349269 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-2c1e8a8f-5f06-4bd6-956b-96f80cdd2363 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Image pref 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 08:32:42.349673 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-2c1e8a8f-5f06-4bd6-956b-96f80cdd2363 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 08:32:42.358159 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2c1e8a8f-5f06-4bd6-956b-96f80cdd2363 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:42.358696 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2c1e8a8f-5f06-4bd6-956b-96f80cdd2363 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:42.359497 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2c1e8a8f-5f06-4bd6-956b-96f80cdd2363 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:42.359925 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2c1e8a8f-5f06-4bd6-956b-96f80cdd2363 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:42.376955 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-2c1e8a8f-5f06-4bd6-956b-96f80cdd2363 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Getting quotas for project d039e505af3b42a3afdc9ac76295e901. Resources: {'cores', 'instances', 'ram'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:32:42.380918 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-2c1e8a8f-5f06-4bd6-956b-96f80cdd2363 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Getting quotas for user 3b8dea90b58a49b391bec5f0a04acb71 and project d039e505af3b42a3afdc9ac76295e901. Resources: {'cores', 'instances', 'ram'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:32:42.391826 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-2c1e8a8f-5f06-4bd6-956b-96f80cdd2363 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Going to run 1 instances... {{(pid=114106) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 19 08:32:42.394753 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-2c1e8a8f-5f06-4bd6-956b-96f80cdd2363 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9102a998-a580-4b4e-b6a1-3172273dd66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114106) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 19 08:32:42.440885 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-2c1e8a8f-5f06-4bd6-956b-96f80cdd2363 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.552114 Oct 19 08:32:42.441541 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 610/1216] 10.222.0.26 () {60 vars in 1146 bytes} [Tue Oct 19 08:32:41 2021] POST /compute/v2.1/servers => generated 400 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 08:32:42.451907 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-43529c78-ee2d-4a96-8f29-22e2884b2768 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:32:42.452597 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-43529c78-ee2d-4a96-8f29-22e2884b2768 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:42.506601 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-43529c78-ee2d-4a96-8f29-22e2884b2768 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:42.513309 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-43529c78-ee2d-4a96-8f29-22e2884b2768 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55" status: 200 len: 1237 microversion: 2.1 time: 0.065343 Oct 19 08:32:42.513860 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 607/1217] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:32:42 2021] GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55 => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:32:43.204325 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-33844474-66cf-4976-b640-be498c7f4902 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:43.206365 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-33844474-66cf-4976-b640-be498c7f4902 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:43.212396 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-33844474-66cf-4976-b640-be498c7f4902 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:43.212838 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-33844474-66cf-4976-b640-be498c7f4902 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:43.213595 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-33844474-66cf-4976-b640-be498c7f4902 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:43.213999 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-33844474-66cf-4976-b640-be498c7f4902 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:43.278629 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-33844474-66cf-4976-b640-be498c7f4902 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28172 microversion: 2.20 time: 0.078259 Oct 19 08:32:43.279293 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 611/1218] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:43 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28172 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:32:43.530206 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-92edb183-01b7-45fc-8ce9-591c6ffdf7c0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:32:43.530845 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-92edb183-01b7-45fc-8ce9-591c6ffdf7c0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:43.538722 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-92edb183-01b7-45fc-8ce9-591c6ffdf7c0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:43.539165 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-92edb183-01b7-45fc-8ce9-591c6ffdf7c0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:43.539954 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-92edb183-01b7-45fc-8ce9-591c6ffdf7c0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:43.540427 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-92edb183-01b7-45fc-8ce9-591c6ffdf7c0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:43.607245 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-92edb183-01b7-45fc-8ce9-591c6ffdf7c0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:43.615636 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-92edb183-01b7-45fc-8ce9-591c6ffdf7c0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55" status: 200 len: 1295 microversion: 2.1 time: 0.089028 Oct 19 08:32:43.616193 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 608/1219] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:32:43 2021] GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55 => generated 1295 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:32:44.290911 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-42f35e06-c464-4653-916b-6dae9b3beaed tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:44.291811 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-42f35e06-c464-4653-916b-6dae9b3beaed tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:44.298112 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-42f35e06-c464-4653-916b-6dae9b3beaed tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:44.299086 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-42f35e06-c464-4653-916b-6dae9b3beaed tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:44.299989 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-42f35e06-c464-4653-916b-6dae9b3beaed tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:44.300408 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-42f35e06-c464-4653-916b-6dae9b3beaed tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:44.382901 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-42f35e06-c464-4653-916b-6dae9b3beaed tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28172 microversion: 2.20 time: 0.095929 Oct 19 08:32:44.383550 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 612/1220] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:44 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28172 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:32:44.635066 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2e2b734b-5aca-420b-93ee-9a80a6bd477b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:32:44.636792 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2e2b734b-5aca-420b-93ee-9a80a6bd477b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:44.638277 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-483a7803-265e-4ae4-b71a-7049cdea6ebb req-522ee7f8-4459-44e8-8324-14304f9096b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8da1c23b-61b7-480c-b3b4-90f5793c0f55", "tag": "7532eae6-a4a9-45d4-a23f-5cc7a5b33a17"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:44.639678 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:32:44.639678 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:32:44.648372 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2e2b734b-5aca-420b-93ee-9a80a6bd477b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:44.651309 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2e2b734b-5aca-420b-93ee-9a80a6bd477b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:44.651474 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-483a7803-265e-4ae4-b71a-7049cdea6ebb req-522ee7f8-4459-44e8-8324-14304f9096b3 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:44.651835 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-483a7803-265e-4ae4-b71a-7049cdea6ebb req-522ee7f8-4459-44e8-8324-14304f9096b3 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:44.652483 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2e2b734b-5aca-420b-93ee-9a80a6bd477b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:44.653050 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2e2b734b-5aca-420b-93ee-9a80a6bd477b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:44.664512 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-483a7803-265e-4ae4-b71a-7049cdea6ebb req-522ee7f8-4459-44e8-8324-14304f9096b3 service nova] Creating event network-changed:7532eae6-a4a9-45d4-a23f-5cc7a5b33a17 for instance 8da1c23b-61b7-480c-b3b4-90f5793c0f55 on hv-cinder-81398 Oct 19 08:32:44.675270 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-483a7803-265e-4ae4-b71a-7049cdea6ebb req-522ee7f8-4459-44e8-8324-14304f9096b3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040717 Oct 19 08:32:44.676202 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 613/1221] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:32:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:32:44.879636 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-2e2b734b-5aca-420b-93ee-9a80a6bd477b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:44.886719 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2e2b734b-5aca-420b-93ee-9a80a6bd477b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55" status: 200 len: 1361 microversion: 2.1 time: 0.257350 Oct 19 08:32:44.887540 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 609/1222] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:32:44 2021] GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55 => generated 1361 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:32:45.395863 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-8e6bdb95-a297-4bc9-9f71-76bd27282279 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:45.396846 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-8e6bdb95-a297-4bc9-9f71-76bd27282279 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:45.403026 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8e6bdb95-a297-4bc9-9f71-76bd27282279 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:45.403469 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8e6bdb95-a297-4bc9-9f71-76bd27282279 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:45.404232 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8e6bdb95-a297-4bc9-9f71-76bd27282279 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:45.404663 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8e6bdb95-a297-4bc9-9f71-76bd27282279 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:45.559228 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-8e6bdb95-a297-4bc9-9f71-76bd27282279 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28172 microversion: 2.20 time: 0.167474 Oct 19 08:32:45.560159 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 614/1223] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:45 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28172 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:32:45.903545 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-731eb091-b190-4473-853a-a6a2f8796d5c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:32:45.904074 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-731eb091-b190-4473-853a-a6a2f8796d5c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:45.911437 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-731eb091-b190-4473-853a-a6a2f8796d5c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:45.911876 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-731eb091-b190-4473-853a-a6a2f8796d5c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:45.912628 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-731eb091-b190-4473-853a-a6a2f8796d5c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:45.913052 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-731eb091-b190-4473-853a-a6a2f8796d5c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:46.035162 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-731eb091-b190-4473-853a-a6a2f8796d5c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:46.042271 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-731eb091-b190-4473-853a-a6a2f8796d5c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55" status: 200 len: 1361 microversion: 2.1 time: 0.142454 Oct 19 08:32:46.042848 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 610/1224] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:32:45 2021] GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55 => generated 1361 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:32:46.573626 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-4a939fa8-6b79-4067-bc66-8f0b2b180501 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:46.574619 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-4a939fa8-6b79-4067-bc66-8f0b2b180501 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:46.581013 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4a939fa8-6b79-4067-bc66-8f0b2b180501 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:46.581449 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4a939fa8-6b79-4067-bc66-8f0b2b180501 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:46.582571 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4a939fa8-6b79-4067-bc66-8f0b2b180501 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:46.583000 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4a939fa8-6b79-4067-bc66-8f0b2b180501 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:46.709450 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-4a939fa8-6b79-4067-bc66-8f0b2b180501 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28172 microversion: 2.20 time: 0.139583 Oct 19 08:32:46.710018 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 615/1225] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:46 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28172 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:32:47.059364 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-e6f83c22-d073-4915-aead-32ce686b6058 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:32:47.059911 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-e6f83c22-d073-4915-aead-32ce686b6058 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:47.065861 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e6f83c22-d073-4915-aead-32ce686b6058 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:47.066312 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e6f83c22-d073-4915-aead-32ce686b6058 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:47.067134 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e6f83c22-d073-4915-aead-32ce686b6058 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:47.067566 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e6f83c22-d073-4915-aead-32ce686b6058 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:47.188309 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-e6f83c22-d073-4915-aead-32ce686b6058 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:47.195530 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-e6f83c22-d073-4915-aead-32ce686b6058 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55" status: 200 len: 1361 microversion: 2.1 time: 0.139876 Oct 19 08:32:47.196082 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 611/1226] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:32:47 2021] GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55 => generated 1361 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:32:47.721408 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-1de3e796-6f25-4472-9b5e-d9720d029652 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:47.722620 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-1de3e796-6f25-4472-9b5e-d9720d029652 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:47.729007 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1de3e796-6f25-4472-9b5e-d9720d029652 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:47.729440 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1de3e796-6f25-4472-9b5e-d9720d029652 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:47.730184 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1de3e796-6f25-4472-9b5e-d9720d029652 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:47.730642 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1de3e796-6f25-4472-9b5e-d9720d029652 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:47.844669 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-1de3e796-6f25-4472-9b5e-d9720d029652 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28172 microversion: 2.20 time: 0.127216 Oct 19 08:32:47.845289 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 616/1227] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:47 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28172 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:32:48.212942 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-f3d8bb64-b4a8-4c21-b431-df5655a144a4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:32:48.213577 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-f3d8bb64-b4a8-4c21-b431-df5655a144a4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:48.219443 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f3d8bb64-b4a8-4c21-b431-df5655a144a4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:48.219887 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f3d8bb64-b4a8-4c21-b431-df5655a144a4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:48.220649 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f3d8bb64-b4a8-4c21-b431-df5655a144a4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:48.221082 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f3d8bb64-b4a8-4c21-b431-df5655a144a4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:48.338346 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-f3d8bb64-b4a8-4c21-b431-df5655a144a4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:48.345382 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-f3d8bb64-b4a8-4c21-b431-df5655a144a4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55" status: 200 len: 1361 microversion: 2.1 time: 0.136090 Oct 19 08:32:48.345938 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 612/1228] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:32:48 2021] GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55 => generated 1361 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:32:48.856611 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-fb7bde10-92d0-4464-aedf-97601613a6e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:48.857600 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-fb7bde10-92d0-4464-aedf-97601613a6e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:48.864735 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fb7bde10-92d0-4464-aedf-97601613a6e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:48.865172 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fb7bde10-92d0-4464-aedf-97601613a6e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:48.865918 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fb7bde10-92d0-4464-aedf-97601613a6e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:48.866338 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fb7bde10-92d0-4464-aedf-97601613a6e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:48.929695 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-fb7bde10-92d0-4464-aedf-97601613a6e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28172 microversion: 2.20 time: 0.077023 Oct 19 08:32:48.930292 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 617/1229] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:48 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28172 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:32:49.362394 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-3a979b02-254d-45a8-881a-2d8ab9269e49 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:32:49.363557 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-3a979b02-254d-45a8-881a-2d8ab9269e49 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:49.369348 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3a979b02-254d-45a8-881a-2d8ab9269e49 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:49.369793 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3a979b02-254d-45a8-881a-2d8ab9269e49 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:49.370592 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3a979b02-254d-45a8-881a-2d8ab9269e49 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:49.371010 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3a979b02-254d-45a8-881a-2d8ab9269e49 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:49.492042 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-3a979b02-254d-45a8-881a-2d8ab9269e49 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:49.499199 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-3a979b02-254d-45a8-881a-2d8ab9269e49 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55" status: 200 len: 1361 microversion: 2.1 time: 0.140435 Oct 19 08:32:49.499748 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 613/1230] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:32:49 2021] GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55 => generated 1361 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:32:49.941349 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-263c8bca-e631-4d5e-bfac-4d07e7d56dfb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:49.942329 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-263c8bca-e631-4d5e-bfac-4d07e7d56dfb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:49.948775 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-263c8bca-e631-4d5e-bfac-4d07e7d56dfb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:49.949213 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-263c8bca-e631-4d5e-bfac-4d07e7d56dfb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:49.949962 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-263c8bca-e631-4d5e-bfac-4d07e7d56dfb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:49.950385 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-263c8bca-e631-4d5e-bfac-4d07e7d56dfb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:50.012956 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-263c8bca-e631-4d5e-bfac-4d07e7d56dfb tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28172 microversion: 2.20 time: 0.075548 Oct 19 08:32:50.016827 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 618/1231] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:49 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28172 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:32:50.517153 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-e07ffc64-0542-4414-95d5-e1c6e37cd1cf tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:32:50.517899 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-e07ffc64-0542-4414-95d5-e1c6e37cd1cf tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:50.525205 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e07ffc64-0542-4414-95d5-e1c6e37cd1cf tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:50.525643 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e07ffc64-0542-4414-95d5-e1c6e37cd1cf tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:50.526400 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e07ffc64-0542-4414-95d5-e1c6e37cd1cf tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:50.527374 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e07ffc64-0542-4414-95d5-e1c6e37cd1cf tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:50.649329 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-e07ffc64-0542-4414-95d5-e1c6e37cd1cf tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:50.656491 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-e07ffc64-0542-4414-95d5-e1c6e37cd1cf tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55" status: 200 len: 1361 microversion: 2.1 time: 0.142952 Oct 19 08:32:50.656985 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 614/1232] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:32:50 2021] GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55 => generated 1361 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:32:51.024936 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-bd84e4b4-ca5e-4ac4-83de-22648ed040d3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:51.026020 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-bd84e4b4-ca5e-4ac4-83de-22648ed040d3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:51.032409 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bd84e4b4-ca5e-4ac4-83de-22648ed040d3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:51.032855 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bd84e4b4-ca5e-4ac4-83de-22648ed040d3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:51.033612 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bd84e4b4-ca5e-4ac4-83de-22648ed040d3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:51.034035 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bd84e4b4-ca5e-4ac4-83de-22648ed040d3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:51.095794 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-bd84e4b4-ca5e-4ac4-83de-22648ed040d3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28172 microversion: 2.20 time: 0.075495 Oct 19 08:32:51.096402 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 619/1233] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:51 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28172 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:32:51.673717 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-dca28907-1976-4c8c-a081-7f88e694f608 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:32:51.674208 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-dca28907-1976-4c8c-a081-7f88e694f608 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:51.680213 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dca28907-1976-4c8c-a081-7f88e694f608 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:51.680651 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dca28907-1976-4c8c-a081-7f88e694f608 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:51.681393 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dca28907-1976-4c8c-a081-7f88e694f608 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:51.681813 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dca28907-1976-4c8c-a081-7f88e694f608 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:51.798965 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-dca28907-1976-4c8c-a081-7f88e694f608 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:51.807096 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-dca28907-1976-4c8c-a081-7f88e694f608 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55" status: 200 len: 1361 microversion: 2.1 time: 0.137101 Oct 19 08:32:51.807654 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 615/1234] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:32:51 2021] GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55 => generated 1361 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:32:52.062982 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-8e48563c-28bd-4b86-9c1e-85ecaeb07ffb req-c920a8b4-9d94-45c0-9ed8-e8e3e9e64c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8da1c23b-61b7-480c-b3b4-90f5793c0f55", "name": "network-vif-plugged", "status": "completed", "tag": "7532eae6-a4a9-45d4-a23f-5cc7a5b33a17"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:52.064467 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:32:52.064467 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:32:52.071738 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-8e48563c-28bd-4b86-9c1e-85ecaeb07ffb req-c920a8b4-9d94-45c0-9ed8-e8e3e9e64c4a service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:52.072217 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-8e48563c-28bd-4b86-9c1e-85ecaeb07ffb req-c920a8b4-9d94-45c0-9ed8-e8e3e9e64c4a service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:52.084002 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-8e48563c-28bd-4b86-9c1e-85ecaeb07ffb req-c920a8b4-9d94-45c0-9ed8-e8e3e9e64c4a service nova] Creating event network-vif-plugged:7532eae6-a4a9-45d4-a23f-5cc7a5b33a17 for instance 8da1c23b-61b7-480c-b3b4-90f5793c0f55 on hv-cinder-81398 Oct 19 08:32:52.088865 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-8e48563c-28bd-4b86-9c1e-85ecaeb07ffb req-c920a8b4-9d94-45c0-9ed8-e8e3e9e64c4a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029849 Oct 19 08:32:52.089435 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 620/1235] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:32:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:32:52.107653 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-4ae0b86b-f4f8-43c9-902c-b38948485512 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:52.108593 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-4ae0b86b-f4f8-43c9-902c-b38948485512 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:52.115142 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4ae0b86b-f4f8-43c9-902c-b38948485512 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:52.115582 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4ae0b86b-f4f8-43c9-902c-b38948485512 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:52.116344 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4ae0b86b-f4f8-43c9-902c-b38948485512 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:52.116952 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4ae0b86b-f4f8-43c9-902c-b38948485512 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:52.182281 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-4ae0b86b-f4f8-43c9-902c-b38948485512 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28172 microversion: 2.20 time: 0.078029 Oct 19 08:32:52.186081 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 616/1236] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:52 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28172 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:32:52.825257 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c02f4e98-8712-4f9b-b002-2dee240509ee tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:32:52.825937 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c02f4e98-8712-4f9b-b002-2dee240509ee tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:52.832470 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c02f4e98-8712-4f9b-b002-2dee240509ee tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:52.832842 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c02f4e98-8712-4f9b-b002-2dee240509ee tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:52.833595 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c02f4e98-8712-4f9b-b002-2dee240509ee tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:52.834011 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c02f4e98-8712-4f9b-b002-2dee240509ee tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:52.956127 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-c02f4e98-8712-4f9b-b002-2dee240509ee tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:52.963246 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c02f4e98-8712-4f9b-b002-2dee240509ee tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55" status: 200 len: 1361 microversion: 2.1 time: 0.141906 Oct 19 08:32:52.963797 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 621/1237] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:32:52 2021] GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55 => generated 1361 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:32:53.194273 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-724762d6-8cd7-4e13-9111-fb808b7ab8f4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:53.195171 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-724762d6-8cd7-4e13-9111-fb808b7ab8f4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:53.201761 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-724762d6-8cd7-4e13-9111-fb808b7ab8f4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:53.202200 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-724762d6-8cd7-4e13-9111-fb808b7ab8f4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:53.202980 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-724762d6-8cd7-4e13-9111-fb808b7ab8f4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:53.203401 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-724762d6-8cd7-4e13-9111-fb808b7ab8f4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:53.300191 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-724762d6-8cd7-4e13-9111-fb808b7ab8f4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28463 microversion: 2.20 time: 0.109895 Oct 19 08:32:53.300935 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 617/1238] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:53 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28463 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:32:53.979882 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-14a71eac-b177-4fb4-87d0-3244201588c7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:32:53.980466 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-14a71eac-b177-4fb4-87d0-3244201588c7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:53.986611 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-14a71eac-b177-4fb4-87d0-3244201588c7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:53.987054 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-14a71eac-b177-4fb4-87d0-3244201588c7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:53.987977 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-14a71eac-b177-4fb4-87d0-3244201588c7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:53.989187 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-14a71eac-b177-4fb4-87d0-3244201588c7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:54.109495 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-14a71eac-b177-4fb4-87d0-3244201588c7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:32:54.117322 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-14a71eac-b177-4fb4-87d0-3244201588c7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55" status: 200 len: 1547 microversion: 2.1 time: 0.141158 Oct 19 08:32:54.117873 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 622/1239] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:32:53 2021] GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55 => generated 1547 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:32:54.134047 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8c895180-9d2f-4c56-9e52-60b8e7e72856 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:32:54.134678 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-8c895180-9d2f-4c56-9e52-60b8e7e72856 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:54.141233 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8c895180-9d2f-4c56-9e52-60b8e7e72856 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:54.141667 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8c895180-9d2f-4c56-9e52-60b8e7e72856 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:54.142413 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8c895180-9d2f-4c56-9e52-60b8e7e72856 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:54.142865 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8c895180-9d2f-4c56-9e52-60b8e7e72856 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:54.219943 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-8c895180-9d2f-4c56-9e52-60b8e7e72856 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089768 Oct 19 08:32:54.220701 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 618/1240] 10.222.0.26 () {58 vars in 1274 bytes} [Tue Oct 19 08:32:54 2021] GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:32:54.311792 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-40bc1d44-2011-4d25-b0c6-45c903901313 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:54.312720 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-40bc1d44-2011-4d25-b0c6-45c903901313 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:54.318594 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-40bc1d44-2011-4d25-b0c6-45c903901313 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:54.318964 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-40bc1d44-2011-4d25-b0c6-45c903901313 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:54.319706 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-40bc1d44-2011-4d25-b0c6-45c903901313 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:54.320125 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-40bc1d44-2011-4d25-b0c6-45c903901313 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:54.395729 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-40bc1d44-2011-4d25-b0c6-45c903901313 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28463 microversion: 2.20 time: 0.087507 Oct 19 08:32:54.399883 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 623/1241] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:54 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28463 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:32:55.401117 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-4c7c1c09-f14c-4527-b9a2-2a17b7831eaf tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:55.404123 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-a93d7e39-862c-4858-94a8-27db7b86b39b req-f5d40b1a-f371-4ffa-8303-25d15127b06c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8da1c23b-61b7-480c-b3b4-90f5793c0f55", "tag": "7532eae6-a4a9-45d4-a23f-5cc7a5b33a17"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:55.405586 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:32:55.405586 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:32:55.408734 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-4c7c1c09-f14c-4527-b9a2-2a17b7831eaf tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:55.413904 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-a93d7e39-862c-4858-94a8-27db7b86b39b req-f5d40b1a-f371-4ffa-8303-25d15127b06c service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:55.414336 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-a93d7e39-862c-4858-94a8-27db7b86b39b req-f5d40b1a-f371-4ffa-8303-25d15127b06c service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:55.416011 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4c7c1c09-f14c-4527-b9a2-2a17b7831eaf tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:55.416453 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4c7c1c09-f14c-4527-b9a2-2a17b7831eaf tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:55.417213 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4c7c1c09-f14c-4527-b9a2-2a17b7831eaf tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:55.417859 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4c7c1c09-f14c-4527-b9a2-2a17b7831eaf tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:55.426864 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-a93d7e39-862c-4858-94a8-27db7b86b39b req-f5d40b1a-f371-4ffa-8303-25d15127b06c service nova] Creating event network-changed:7532eae6-a4a9-45d4-a23f-5cc7a5b33a17 for instance 8da1c23b-61b7-480c-b3b4-90f5793c0f55 on hv-cinder-81398 Oct 19 08:32:55.431806 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-a93d7e39-862c-4858-94a8-27db7b86b39b req-f5d40b1a-f371-4ffa-8303-25d15127b06c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032516 Oct 19 08:32:55.432389 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 624/1242] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:32:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:32:55.438527 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-0e0c3e69-d927-4854-a860-3a7389758cb2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:55.439736 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-0e0c3e69-d927-4854-a860-3a7389758cb2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:55.445840 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0e0c3e69-d927-4854-a860-3a7389758cb2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:55.446296 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0e0c3e69-d927-4854-a860-3a7389758cb2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:55.447097 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0e0c3e69-d927-4854-a860-3a7389758cb2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:55.447517 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0e0c3e69-d927-4854-a860-3a7389758cb2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:55.507652 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-4c7c1c09-f14c-4527-b9a2-2a17b7831eaf tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 14 microversion: 2.1 time: 0.110554 Oct 19 08:32:55.510952 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 619/1243] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:32:55 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 08:32:55.540319 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-0e0c3e69-d927-4854-a860-3a7389758cb2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28631 microversion: 2.20 time: 0.106354 Oct 19 08:32:55.541825 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 625/1244] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:55 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28631 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:32:56.519445 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-6b32ddda-a184-43f4-8cf8-d61e7d25324d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:56.520431 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-6b32ddda-a184-43f4-8cf8-d61e7d25324d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:56.527500 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b32ddda-a184-43f4-8cf8-d61e7d25324d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:56.527954 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b32ddda-a184-43f4-8cf8-d61e7d25324d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:56.528737 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b32ddda-a184-43f4-8cf8-d61e7d25324d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:56.529171 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b32ddda-a184-43f4-8cf8-d61e7d25324d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:56.553891 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e400c396-943a-4459-aad7-6675b708ed99 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:56.554933 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e400c396-943a-4459-aad7-6675b708ed99 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:56.561397 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e400c396-943a-4459-aad7-6675b708ed99 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:56.561840 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e400c396-943a-4459-aad7-6675b708ed99 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:56.562625 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e400c396-943a-4459-aad7-6675b708ed99 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:56.563056 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e400c396-943a-4459-aad7-6675b708ed99 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:56.591140 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-6b32ddda-a184-43f4-8cf8-d61e7d25324d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 14 microversion: 2.1 time: 0.075581 Oct 19 08:32:56.591741 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 620/1245] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:32:56 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 08:32:56.633550 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e400c396-943a-4459-aad7-6675b708ed99 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28631 microversion: 2.20 time: 0.084240 Oct 19 08:32:56.634189 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 626/1246] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:56 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28631 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:32:57.602508 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-3506c505-2567-4013-aa0b-81bc0dc6ca7a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:57.603502 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-3506c505-2567-4013-aa0b-81bc0dc6ca7a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:57.609899 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3506c505-2567-4013-aa0b-81bc0dc6ca7a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:57.610339 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3506c505-2567-4013-aa0b-81bc0dc6ca7a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:57.611130 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3506c505-2567-4013-aa0b-81bc0dc6ca7a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:57.611557 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3506c505-2567-4013-aa0b-81bc0dc6ca7a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:57.646326 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a1a65fad-aa30-4328-9d87-1247f518b4ca tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:57.647260 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a1a65fad-aa30-4328-9d87-1247f518b4ca tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:57.653594 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a1a65fad-aa30-4328-9d87-1247f518b4ca tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:57.654032 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a1a65fad-aa30-4328-9d87-1247f518b4ca tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:57.654807 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a1a65fad-aa30-4328-9d87-1247f518b4ca tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:57.655228 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a1a65fad-aa30-4328-9d87-1247f518b4ca tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:57.679149 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-3506c505-2567-4013-aa0b-81bc0dc6ca7a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 14 microversion: 2.1 time: 0.080511 Oct 19 08:32:57.680763 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 621/1247] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:32:57 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 08:32:57.721399 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a1a65fad-aa30-4328-9d87-1247f518b4ca tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28631 microversion: 2.20 time: 0.079301 Oct 19 08:32:57.722454 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 627/1248] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:57 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28631 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:32:58.690574 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-9d70769c-862a-41e5-a3e9-a623158e6e21 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:58.691650 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-9d70769c-862a-41e5-a3e9-a623158e6e21 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:58.698054 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9d70769c-862a-41e5-a3e9-a623158e6e21 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:58.698521 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9d70769c-862a-41e5-a3e9-a623158e6e21 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:58.699300 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9d70769c-862a-41e5-a3e9-a623158e6e21 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:58.699732 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9d70769c-862a-41e5-a3e9-a623158e6e21 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:58.733446 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-81a7d2ca-2dae-44cb-8811-76d8cc43159d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:58.734414 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-81a7d2ca-2dae-44cb-8811-76d8cc43159d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:58.741852 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-81a7d2ca-2dae-44cb-8811-76d8cc43159d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:58.743250 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-81a7d2ca-2dae-44cb-8811-76d8cc43159d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:58.744778 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-81a7d2ca-2dae-44cb-8811-76d8cc43159d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:58.745975 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-81a7d2ca-2dae-44cb-8811-76d8cc43159d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:58.761806 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-9d70769c-862a-41e5-a3e9-a623158e6e21 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 14 microversion: 2.1 time: 0.075262 Oct 19 08:32:58.762849 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 622/1249] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:32:58 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 08:32:58.809469 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-81a7d2ca-2dae-44cb-8811-76d8cc43159d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28631 microversion: 2.20 time: 0.080014 Oct 19 08:32:58.810346 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 628/1250] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:58 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28631 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:32:59.773490 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-34c4654c-7c5e-479a-a31f-f6bf541e11cb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:59.774383 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-34c4654c-7c5e-479a-a31f-f6bf541e11cb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:59.780871 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-34c4654c-7c5e-479a-a31f-f6bf541e11cb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:59.781311 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-34c4654c-7c5e-479a-a31f-f6bf541e11cb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:59.782062 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-34c4654c-7c5e-479a-a31f-f6bf541e11cb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:59.782484 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-34c4654c-7c5e-479a-a31f-f6bf541e11cb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:59.821984 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-091ba59e-7a33-4a38-a6b4-4fec316f9159 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:32:59.823055 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-091ba59e-7a33-4a38-a6b4-4fec316f9159 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:32:59.829393 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-091ba59e-7a33-4a38-a6b4-4fec316f9159 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:59.829838 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-091ba59e-7a33-4a38-a6b4-4fec316f9159 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:59.830611 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-091ba59e-7a33-4a38-a6b4-4fec316f9159 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:32:59.831036 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-091ba59e-7a33-4a38-a6b4-4fec316f9159 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:32:59.844224 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-34c4654c-7c5e-479a-a31f-f6bf541e11cb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 14 microversion: 2.1 time: 0.074726 Oct 19 08:32:59.846621 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 623/1251] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:32:59 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 08:32:59.893447 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-091ba59e-7a33-4a38-a6b4-4fec316f9159 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28631 microversion: 2.20 time: 0.075359 Oct 19 08:32:59.894090 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 629/1252] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:32:59 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28631 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:33:00.856823 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-4453a35b-fe70-45ec-9f78-d4ab0f3c2425 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:00.857812 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-4453a35b-fe70-45ec-9f78-d4ab0f3c2425 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:00.864964 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4453a35b-fe70-45ec-9f78-d4ab0f3c2425 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:00.865401 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4453a35b-fe70-45ec-9f78-d4ab0f3c2425 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:00.866143 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4453a35b-fe70-45ec-9f78-d4ab0f3c2425 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:00.866596 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4453a35b-fe70-45ec-9f78-d4ab0f3c2425 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:00.905278 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-24f3118f-24d6-4ec3-929e-fda15288aefd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:00.906261 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-24f3118f-24d6-4ec3-929e-fda15288aefd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:00.913266 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-24f3118f-24d6-4ec3-929e-fda15288aefd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:00.913705 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-24f3118f-24d6-4ec3-929e-fda15288aefd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:00.914459 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-24f3118f-24d6-4ec3-929e-fda15288aefd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:00.914910 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-24f3118f-24d6-4ec3-929e-fda15288aefd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:00.932162 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-4453a35b-fe70-45ec-9f78-d4ab0f3c2425 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 14 microversion: 2.1 time: 0.079175 Oct 19 08:33:00.932927 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 624/1253] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:00 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 08:33:00.986655 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-24f3118f-24d6-4ec3-929e-fda15288aefd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28631 microversion: 2.20 time: 0.085205 Oct 19 08:33:00.987290 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 630/1254] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:00 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28631 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:33:01.943930 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-42cb9720-e0a8-423b-9121-6e9926c72135 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:01.944903 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-42cb9720-e0a8-423b-9121-6e9926c72135 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:01.951427 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-42cb9720-e0a8-423b-9121-6e9926c72135 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:01.951869 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-42cb9720-e0a8-423b-9121-6e9926c72135 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:01.952650 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-42cb9720-e0a8-423b-9121-6e9926c72135 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:01.953074 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-42cb9720-e0a8-423b-9121-6e9926c72135 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:01.999308 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-0d1dcb92-63c5-44c9-8cc7-cbf37ccde627 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:02.000287 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-0d1dcb92-63c5-44c9-8cc7-cbf37ccde627 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:02.007423 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0d1dcb92-63c5-44c9-8cc7-cbf37ccde627 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:02.007854 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0d1dcb92-63c5-44c9-8cc7-cbf37ccde627 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:02.008604 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0d1dcb92-63c5-44c9-8cc7-cbf37ccde627 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:02.009466 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0d1dcb92-63c5-44c9-8cc7-cbf37ccde627 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:02.011406 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-42cb9720-e0a8-423b-9121-6e9926c72135 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 14 microversion: 2.1 time: 0.071867 Oct 19 08:33:02.012160 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 625/1255] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:01 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 08:33:02.072519 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-0d1dcb92-63c5-44c9-8cc7-cbf37ccde627 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28631 microversion: 2.20 time: 0.077246 Oct 19 08:33:02.073146 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 631/1256] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:01 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28631 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:33:03.023597 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-b94202c4-1c6d-4101-9a2d-358a03b0b537 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:03.024582 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-b94202c4-1c6d-4101-9a2d-358a03b0b537 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:03.030965 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b94202c4-1c6d-4101-9a2d-358a03b0b537 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:03.031403 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b94202c4-1c6d-4101-9a2d-358a03b0b537 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:03.032149 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b94202c4-1c6d-4101-9a2d-358a03b0b537 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:03.032574 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b94202c4-1c6d-4101-9a2d-358a03b0b537 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:03.084903 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-5e78478e-f641-400d-80a0-cc3235f169c7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:03.085884 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-5e78478e-f641-400d-80a0-cc3235f169c7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:03.092465 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5e78478e-f641-400d-80a0-cc3235f169c7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:03.092903 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5e78478e-f641-400d-80a0-cc3235f169c7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:03.093653 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5e78478e-f641-400d-80a0-cc3235f169c7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:03.094077 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5e78478e-f641-400d-80a0-cc3235f169c7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:03.100840 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-b94202c4-1c6d-4101-9a2d-358a03b0b537 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 14 microversion: 2.1 time: 0.081802 Oct 19 08:33:03.104152 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 626/1257] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:03 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 08:33:03.153634 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-5e78478e-f641-400d-80a0-cc3235f169c7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28631 microversion: 2.20 time: 0.073061 Oct 19 08:33:03.154258 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 632/1258] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:03 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28631 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:33:04.111373 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-21d8b113-7d0c-4bb9-9398-7e214bacff0c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:04.112375 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-21d8b113-7d0c-4bb9-9398-7e214bacff0c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:04.118738 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-21d8b113-7d0c-4bb9-9398-7e214bacff0c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:04.119202 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-21d8b113-7d0c-4bb9-9398-7e214bacff0c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:04.119947 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-21d8b113-7d0c-4bb9-9398-7e214bacff0c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:04.120370 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-21d8b113-7d0c-4bb9-9398-7e214bacff0c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:04.165966 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b6110d4d-3d1a-4422-a032-8548ccc3792c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:04.166995 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b6110d4d-3d1a-4422-a032-8548ccc3792c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:04.173407 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b6110d4d-3d1a-4422-a032-8548ccc3792c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:04.173851 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b6110d4d-3d1a-4422-a032-8548ccc3792c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:04.174633 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b6110d4d-3d1a-4422-a032-8548ccc3792c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:04.175066 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b6110d4d-3d1a-4422-a032-8548ccc3792c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:04.186029 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-21d8b113-7d0c-4bb9-9398-7e214bacff0c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 14 microversion: 2.1 time: 0.078480 Oct 19 08:33:04.189162 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 627/1259] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:04 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 08:33:04.237244 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b6110d4d-3d1a-4422-a032-8548ccc3792c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28631 microversion: 2.20 time: 0.075161 Oct 19 08:33:04.237850 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 633/1260] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:04 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28631 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:33:05.198002 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8e86182c-fee3-4911-b9cc-028a4573e1c3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:05.199016 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-8e86182c-fee3-4911-b9cc-028a4573e1c3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:05.205451 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8e86182c-fee3-4911-b9cc-028a4573e1c3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:05.205895 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8e86182c-fee3-4911-b9cc-028a4573e1c3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:05.206828 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8e86182c-fee3-4911-b9cc-028a4573e1c3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:05.207129 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8e86182c-fee3-4911-b9cc-028a4573e1c3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:05.249584 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-5861409c-7ab5-48c5-a8e0-2c3028fe7a8e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:05.250623 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-5861409c-7ab5-48c5-a8e0-2c3028fe7a8e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:05.258289 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5861409c-7ab5-48c5-a8e0-2c3028fe7a8e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:05.259105 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5861409c-7ab5-48c5-a8e0-2c3028fe7a8e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:05.259554 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5861409c-7ab5-48c5-a8e0-2c3028fe7a8e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:05.260066 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5861409c-7ab5-48c5-a8e0-2c3028fe7a8e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:05.265381 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-8e86182c-fee3-4911-b9cc-028a4573e1c3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 14 microversion: 2.1 time: 0.071241 Oct 19 08:33:05.266215 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 628/1261] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:05 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 08:33:05.329365 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-5861409c-7ab5-48c5-a8e0-2c3028fe7a8e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28631 microversion: 2.20 time: 0.083681 Oct 19 08:33:05.330030 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 634/1262] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:05 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28631 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:33:06.277291 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-daf6c539-eaca-4ce8-b75d-10077114eea1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:06.278288 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-daf6c539-eaca-4ce8-b75d-10077114eea1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:06.284669 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-daf6c539-eaca-4ce8-b75d-10077114eea1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:06.285116 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-daf6c539-eaca-4ce8-b75d-10077114eea1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:06.285872 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-daf6c539-eaca-4ce8-b75d-10077114eea1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:06.286303 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-daf6c539-eaca-4ce8-b75d-10077114eea1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:06.341332 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-146a9c8d-34e5-4461-b03f-bff0614a6f88 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:06.342336 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-146a9c8d-34e5-4461-b03f-bff0614a6f88 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:06.348782 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-146a9c8d-34e5-4461-b03f-bff0614a6f88 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:06.349304 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-146a9c8d-34e5-4461-b03f-bff0614a6f88 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:06.350053 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-146a9c8d-34e5-4461-b03f-bff0614a6f88 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:06.350476 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-146a9c8d-34e5-4461-b03f-bff0614a6f88 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:06.355658 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-daf6c539-eaca-4ce8-b75d-10077114eea1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 14 microversion: 2.1 time: 0.082236 Oct 19 08:33:06.358779 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 629/1263] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:06 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 08:33:06.416079 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-146a9c8d-34e5-4461-b03f-bff0614a6f88 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28631 microversion: 2.20 time: 0.078586 Oct 19 08:33:06.416737 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 635/1264] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:06 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28631 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:33:07.367244 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-205cc0a8-1373-40be-b5ec-bc126040f1cb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:07.368325 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-205cc0a8-1373-40be-b5ec-bc126040f1cb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:07.374801 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-205cc0a8-1373-40be-b5ec-bc126040f1cb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:07.375241 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-205cc0a8-1373-40be-b5ec-bc126040f1cb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:07.376001 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-205cc0a8-1373-40be-b5ec-bc126040f1cb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:07.376417 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-205cc0a8-1373-40be-b5ec-bc126040f1cb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:07.427550 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b23d95e4-0e98-4baa-80da-d6b96ae81a8c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:07.428547 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b23d95e4-0e98-4baa-80da-d6b96ae81a8c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:07.434974 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b23d95e4-0e98-4baa-80da-d6b96ae81a8c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:07.435420 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b23d95e4-0e98-4baa-80da-d6b96ae81a8c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:07.436176 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b23d95e4-0e98-4baa-80da-d6b96ae81a8c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:07.436605 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b23d95e4-0e98-4baa-80da-d6b96ae81a8c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:07.443040 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-205cc0a8-1373-40be-b5ec-bc126040f1cb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 14 microversion: 2.1 time: 0.079850 Oct 19 08:33:07.446309 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 630/1265] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:07 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 08:33:07.509380 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b23d95e4-0e98-4baa-80da-d6b96ae81a8c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28631 microversion: 2.20 time: 0.085775 Oct 19 08:33:07.510019 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 636/1266] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:07 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28631 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:33:08.453910 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-b3d824d0-aa23-441f-861b-11db77b5e4f1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:08.454920 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-b3d824d0-aa23-441f-861b-11db77b5e4f1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:08.461696 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b3d824d0-aa23-441f-861b-11db77b5e4f1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:08.462132 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b3d824d0-aa23-441f-861b-11db77b5e4f1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:08.462909 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b3d824d0-aa23-441f-861b-11db77b5e4f1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:08.463332 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b3d824d0-aa23-441f-861b-11db77b5e4f1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:08.521511 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e410fe0a-1ac9-48f6-9755-bc7c5cd26d26 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:08.522567 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e410fe0a-1ac9-48f6-9755-bc7c5cd26d26 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:08.528886 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e410fe0a-1ac9-48f6-9755-bc7c5cd26d26 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:08.529323 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e410fe0a-1ac9-48f6-9755-bc7c5cd26d26 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:08.530075 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e410fe0a-1ac9-48f6-9755-bc7c5cd26d26 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:08.530518 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e410fe0a-1ac9-48f6-9755-bc7c5cd26d26 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:08.545378 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-b3d824d0-aa23-441f-861b-11db77b5e4f1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 12498 microversion: 2.1 time: 0.095293 Oct 19 08:33:08.548893 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 631/1267] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:08 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 12498 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:08.602118 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e410fe0a-1ac9-48f6-9755-bc7c5cd26d26 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28631 microversion: 2.20 time: 0.084481 Oct 19 08:33:08.602983 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 637/1268] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:08 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28631 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:33:09.557496 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-e5e21ab8-0b9b-4a91-aefa-aaee9ddba0e0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:09.558517 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-e5e21ab8-0b9b-4a91-aefa-aaee9ddba0e0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:09.565059 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e5e21ab8-0b9b-4a91-aefa-aaee9ddba0e0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:09.565505 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e5e21ab8-0b9b-4a91-aefa-aaee9ddba0e0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:09.566269 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e5e21ab8-0b9b-4a91-aefa-aaee9ddba0e0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:09.566739 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e5e21ab8-0b9b-4a91-aefa-aaee9ddba0e0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:09.613622 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-f8e14c80-145f-4456-9f69-486e44f0d3ee tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:09.615253 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-f8e14c80-145f-4456-9f69-486e44f0d3ee tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:09.621548 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f8e14c80-145f-4456-9f69-486e44f0d3ee tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:09.621985 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f8e14c80-145f-4456-9f69-486e44f0d3ee tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:09.622763 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f8e14c80-145f-4456-9f69-486e44f0d3ee tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:09.623187 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f8e14c80-145f-4456-9f69-486e44f0d3ee tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:09.642890 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-e5e21ab8-0b9b-4a91-aefa-aaee9ddba0e0 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 18449 microversion: 2.1 time: 0.089184 Oct 19 08:33:09.646619 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 632/1269] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:09 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 18449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:09.683118 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-f8e14c80-145f-4456-9f69-486e44f0d3ee tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28631 microversion: 2.20 time: 0.073341 Oct 19 08:33:09.683659 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 638/1270] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:09 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28631 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:33:10.654820 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-552210c3-2b56-49ef-ac06-c0767c9846cc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:10.655739 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-552210c3-2b56-49ef-ac06-c0767c9846cc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:10.662064 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-552210c3-2b56-49ef-ac06-c0767c9846cc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:10.662514 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-552210c3-2b56-49ef-ac06-c0767c9846cc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:10.663267 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-552210c3-2b56-49ef-ac06-c0767c9846cc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:10.663688 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-552210c3-2b56-49ef-ac06-c0767c9846cc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:10.695441 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ddea5f6f-3cb3-4ef0-8d16-bc96e0801ff4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:10.696449 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ddea5f6f-3cb3-4ef0-8d16-bc96e0801ff4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:10.702810 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ddea5f6f-3cb3-4ef0-8d16-bc96e0801ff4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:10.703256 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ddea5f6f-3cb3-4ef0-8d16-bc96e0801ff4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:10.704004 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ddea5f6f-3cb3-4ef0-8d16-bc96e0801ff4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:10.704427 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ddea5f6f-3cb3-4ef0-8d16-bc96e0801ff4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:10.744963 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-552210c3-2b56-49ef-ac06-c0767c9846cc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 19133 microversion: 2.1 time: 0.094047 Oct 19 08:33:10.745605 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 633/1271] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:10 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 19133 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:10.775805 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ddea5f6f-3cb3-4ef0-8d16-bc96e0801ff4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28631 microversion: 2.20 time: 0.084796 Oct 19 08:33:10.776428 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 639/1272] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:10 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28631 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:33:11.755982 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-265ea08f-7461-4f10-9e9c-b004e192d530 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:11.757029 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-265ea08f-7461-4f10-9e9c-b004e192d530 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:11.763616 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-265ea08f-7461-4f10-9e9c-b004e192d530 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:11.764059 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-265ea08f-7461-4f10-9e9c-b004e192d530 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:11.764806 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-265ea08f-7461-4f10-9e9c-b004e192d530 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:11.765226 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-265ea08f-7461-4f10-9e9c-b004e192d530 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:11.788539 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ee4e5699-751e-4bc2-9955-1c2b3243bb74 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:11.789581 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ee4e5699-751e-4bc2-9955-1c2b3243bb74 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:11.796850 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ee4e5699-751e-4bc2-9955-1c2b3243bb74 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:11.797290 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ee4e5699-751e-4bc2-9955-1c2b3243bb74 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:11.798051 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ee4e5699-751e-4bc2-9955-1c2b3243bb74 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:11.798476 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ee4e5699-751e-4bc2-9955-1c2b3243bb74 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:11.838534 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-265ea08f-7461-4f10-9e9c-b004e192d530 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 21513 microversion: 2.1 time: 0.086456 Oct 19 08:33:11.842397 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 634/1273] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:11 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 21513 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:11.871680 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ee4e5699-751e-4bc2-9955-1c2b3243bb74 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28631 microversion: 2.20 time: 0.087811 Oct 19 08:33:11.872362 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 640/1274] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:11 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28631 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:33:12.851130 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-81e3772d-568c-4c17-bab6-4f81f0f34150 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:12.852117 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-81e3772d-568c-4c17-bab6-4f81f0f34150 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:12.858472 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-81e3772d-568c-4c17-bab6-4f81f0f34150 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:12.858947 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-81e3772d-568c-4c17-bab6-4f81f0f34150 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:12.859705 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-81e3772d-568c-4c17-bab6-4f81f0f34150 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:12.860136 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-81e3772d-568c-4c17-bab6-4f81f0f34150 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:12.883955 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b686e136-e368-4d4d-8050-511a44efd443 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:12.884941 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b686e136-e368-4d4d-8050-511a44efd443 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:12.891847 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b686e136-e368-4d4d-8050-511a44efd443 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:12.892293 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b686e136-e368-4d4d-8050-511a44efd443 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:12.893036 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b686e136-e368-4d4d-8050-511a44efd443 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:12.893455 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b686e136-e368-4d4d-8050-511a44efd443 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:12.938194 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-81e3772d-568c-4c17-bab6-4f81f0f34150 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 23222 microversion: 2.1 time: 0.091488 Oct 19 08:33:12.938899 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 635/1275] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:12 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 23222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:12.974855 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b686e136-e368-4d4d-8050-511a44efd443 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28631 microversion: 2.20 time: 0.095037 Oct 19 08:33:12.975978 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 641/1276] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:12 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28631 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:33:13.950772 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-e0435be3-020c-4a41-93ef-b2e25510ba7f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:13.951750 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-e0435be3-020c-4a41-93ef-b2e25510ba7f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:13.958096 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e0435be3-020c-4a41-93ef-b2e25510ba7f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:13.958565 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e0435be3-020c-4a41-93ef-b2e25510ba7f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:13.959321 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e0435be3-020c-4a41-93ef-b2e25510ba7f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:13.959775 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e0435be3-020c-4a41-93ef-b2e25510ba7f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:13.987542 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-2df462b2-a06b-473c-834a-3c4acd0ba29d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:13.988515 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-2df462b2-a06b-473c-834a-3c4acd0ba29d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:13.995672 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2df462b2-a06b-473c-834a-3c4acd0ba29d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:13.996106 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2df462b2-a06b-473c-834a-3c4acd0ba29d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:13.996849 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2df462b2-a06b-473c-834a-3c4acd0ba29d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:13.997270 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2df462b2-a06b-473c-834a-3c4acd0ba29d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:14.036676 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-e0435be3-020c-4a41-93ef-b2e25510ba7f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 24297 microversion: 2.1 time: 0.089667 Oct 19 08:33:14.037262 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 636/1277] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:13 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 24297 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:33:14.075506 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-2df462b2-a06b-473c-834a-3c4acd0ba29d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28631 microversion: 2.20 time: 0.091991 Oct 19 08:33:14.076106 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 642/1278] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:13 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28631 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:33:15.048585 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-db91ad9d-5b0c-494a-b5d3-ce38477a33e9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:15.049615 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-db91ad9d-5b0c-494a-b5d3-ce38477a33e9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:15.056876 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-db91ad9d-5b0c-494a-b5d3-ce38477a33e9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:15.057321 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-db91ad9d-5b0c-494a-b5d3-ce38477a33e9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:15.058081 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-db91ad9d-5b0c-494a-b5d3-ce38477a33e9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:15.058538 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-db91ad9d-5b0c-494a-b5d3-ce38477a33e9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:15.087308 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-5d5618c7-4b6d-44f0-aa74-85a213e6ea91 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:15.088320 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-5d5618c7-4b6d-44f0-aa74-85a213e6ea91 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:15.094467 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5d5618c7-4b6d-44f0-aa74-85a213e6ea91 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:15.094928 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5d5618c7-4b6d-44f0-aa74-85a213e6ea91 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:15.095681 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5d5618c7-4b6d-44f0-aa74-85a213e6ea91 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:15.096099 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5d5618c7-4b6d-44f0-aa74-85a213e6ea91 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:15.129186 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-db91ad9d-5b0c-494a-b5d3-ce38477a33e9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 25898 microversion: 2.1 time: 0.084484 Oct 19 08:33:15.129827 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 637/1279] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:15 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 25898 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:15.160652 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-5d5618c7-4b6d-44f0-aa74-85a213e6ea91 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28631 microversion: 2.20 time: 0.077749 Oct 19 08:33:15.161275 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 643/1280] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:15 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28631 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:33:16.140869 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-5cddf5a5-47ae-4e5a-9e18-c8878f572307 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:16.142067 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-5cddf5a5-47ae-4e5a-9e18-c8878f572307 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:16.149432 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5cddf5a5-47ae-4e5a-9e18-c8878f572307 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:16.149871 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5cddf5a5-47ae-4e5a-9e18-c8878f572307 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:16.150662 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5cddf5a5-47ae-4e5a-9e18-c8878f572307 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:16.151086 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5cddf5a5-47ae-4e5a-9e18-c8878f572307 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:16.173589 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-5baa29ca-05e7-4eba-8ffd-b2c91df7addd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:16.175211 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-5baa29ca-05e7-4eba-8ffd-b2c91df7addd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:16.182325 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5baa29ca-05e7-4eba-8ffd-b2c91df7addd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:16.182793 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5baa29ca-05e7-4eba-8ffd-b2c91df7addd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:16.183550 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5baa29ca-05e7-4eba-8ffd-b2c91df7addd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:16.183977 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5baa29ca-05e7-4eba-8ffd-b2c91df7addd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:16.225765 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-5cddf5a5-47ae-4e5a-9e18-c8878f572307 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 27058 microversion: 2.1 time: 0.089361 Oct 19 08:33:16.226424 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 638/1281] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:16 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 27058 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:16.259959 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-5baa29ca-05e7-4eba-8ffd-b2c91df7addd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28631 microversion: 2.20 time: 0.090333 Oct 19 08:33:16.260818 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 644/1282] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:16 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28631 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:33:17.238025 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d6e4a5d0-eaaf-4154-8537-1303ba587662 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:17.239044 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-d6e4a5d0-eaaf-4154-8537-1303ba587662 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:17.246172 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d6e4a5d0-eaaf-4154-8537-1303ba587662 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:17.246659 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d6e4a5d0-eaaf-4154-8537-1303ba587662 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:17.247418 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d6e4a5d0-eaaf-4154-8537-1303ba587662 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:17.247844 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d6e4a5d0-eaaf-4154-8537-1303ba587662 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:17.272073 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-bb3c20d6-8832-46e0-8442-a8c0ddeb01e9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:17.274181 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-bb3c20d6-8832-46e0-8442-a8c0ddeb01e9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:17.280870 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bb3c20d6-8832-46e0-8442-a8c0ddeb01e9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:17.281313 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bb3c20d6-8832-46e0-8442-a8c0ddeb01e9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:17.282071 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bb3c20d6-8832-46e0-8442-a8c0ddeb01e9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:17.282518 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bb3c20d6-8832-46e0-8442-a8c0ddeb01e9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:17.327866 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-d6e4a5d0-eaaf-4154-8537-1303ba587662 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 27554 microversion: 2.1 time: 0.093800 Oct 19 08:33:17.328509 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 639/1283] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:17 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 27554 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:17.359940 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-bb3c20d6-8832-46e0-8442-a8c0ddeb01e9 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28631 microversion: 2.20 time: 0.091661 Oct 19 08:33:17.360550 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 645/1284] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:17 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28631 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:33:18.340625 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8bb000a9-e683-46d3-8dcd-5985b57dbf35 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:18.341631 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-8bb000a9-e683-46d3-8dcd-5985b57dbf35 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:18.348044 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8bb000a9-e683-46d3-8dcd-5985b57dbf35 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:18.348477 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8bb000a9-e683-46d3-8dcd-5985b57dbf35 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:18.349228 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8bb000a9-e683-46d3-8dcd-5985b57dbf35 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:18.349649 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8bb000a9-e683-46d3-8dcd-5985b57dbf35 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:18.372641 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-0bbde37f-f87e-490a-91db-770d64c96ee0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:18.373627 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-0bbde37f-f87e-490a-91db-770d64c96ee0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:18.380071 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0bbde37f-f87e-490a-91db-770d64c96ee0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:18.380503 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0bbde37f-f87e-490a-91db-770d64c96ee0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:18.381255 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0bbde37f-f87e-490a-91db-770d64c96ee0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:18.381677 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0bbde37f-f87e-490a-91db-770d64c96ee0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:18.434978 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-8bb000a9-e683-46d3-8dcd-5985b57dbf35 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 27925 microversion: 2.1 time: 0.098989 Oct 19 08:33:18.435629 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 640/1285] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:18 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 27925 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:18.468271 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-0bbde37f-f87e-490a-91db-770d64c96ee0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28631 microversion: 2.20 time: 0.100237 Oct 19 08:33:18.468890 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 646/1286] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:18 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28631 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:33:19.447616 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2ab7f84a-6e47-4129-b072-9b2e286aa714 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:19.448602 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2ab7f84a-6e47-4129-b072-9b2e286aa714 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:19.455083 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2ab7f84a-6e47-4129-b072-9b2e286aa714 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:19.455522 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2ab7f84a-6e47-4129-b072-9b2e286aa714 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:19.456274 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2ab7f84a-6e47-4129-b072-9b2e286aa714 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:19.456703 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2ab7f84a-6e47-4129-b072-9b2e286aa714 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:19.480689 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e78690d9-2035-47eb-b547-9f516ea35ce3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:19.481674 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e78690d9-2035-47eb-b547-9f516ea35ce3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:19.488035 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e78690d9-2035-47eb-b547-9f516ea35ce3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:19.488474 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e78690d9-2035-47eb-b547-9f516ea35ce3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:19.489235 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e78690d9-2035-47eb-b547-9f516ea35ce3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:19.489658 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e78690d9-2035-47eb-b547-9f516ea35ce3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:19.534606 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2ab7f84a-6e47-4129-b072-9b2e286aa714 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28100 microversion: 2.1 time: 0.091417 Oct 19 08:33:19.535243 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 641/1287] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:19 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28100 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:19.570802 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e78690d9-2035-47eb-b547-9f516ea35ce3 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28631 microversion: 2.20 time: 0.094455 Oct 19 08:33:19.571475 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 647/1288] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:19 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28631 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:33:20.546370 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-ec3664ca-4b0f-4e75-89ac-085d1920c1df tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:20.547375 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-ec3664ca-4b0f-4e75-89ac-085d1920c1df tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:20.553747 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ec3664ca-4b0f-4e75-89ac-085d1920c1df tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:20.554183 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ec3664ca-4b0f-4e75-89ac-085d1920c1df tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:20.554961 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ec3664ca-4b0f-4e75-89ac-085d1920c1df tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:20.555385 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ec3664ca-4b0f-4e75-89ac-085d1920c1df tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:20.582815 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-f490aa6a-374e-4601-8a4e-9b9e8ac97fdd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:20.583834 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-f490aa6a-374e-4601-8a4e-9b9e8ac97fdd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:20.590795 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f490aa6a-374e-4601-8a4e-9b9e8ac97fdd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:20.591240 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f490aa6a-374e-4601-8a4e-9b9e8ac97fdd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:20.591995 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f490aa6a-374e-4601-8a4e-9b9e8ac97fdd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:20.592422 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f490aa6a-374e-4601-8a4e-9b9e8ac97fdd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:20.645856 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-ec3664ca-4b0f-4e75-89ac-085d1920c1df tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28160 microversion: 2.1 time: 0.103296 Oct 19 08:33:20.646542 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 642/1289] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:20 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28160 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:20.686351 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-f490aa6a-374e-4601-8a4e-9b9e8ac97fdd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28631 microversion: 2.20 time: 0.107411 Oct 19 08:33:20.686939 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 648/1290] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:20 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28631 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:33:21.658867 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-3556bf97-a706-4bbf-9cdf-b2edd4d2397f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:21.659837 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-3556bf97-a706-4bbf-9cdf-b2edd4d2397f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:21.666701 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3556bf97-a706-4bbf-9cdf-b2edd4d2397f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:21.667143 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3556bf97-a706-4bbf-9cdf-b2edd4d2397f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:21.667896 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3556bf97-a706-4bbf-9cdf-b2edd4d2397f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:21.668316 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3556bf97-a706-4bbf-9cdf-b2edd4d2397f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:21.698867 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-eb9d5334-f75c-472d-8277-84d38960608f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:21.699879 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-eb9d5334-f75c-472d-8277-84d38960608f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:21.706216 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-eb9d5334-f75c-472d-8277-84d38960608f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:21.706700 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-eb9d5334-f75c-472d-8277-84d38960608f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:21.707455 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-eb9d5334-f75c-472d-8277-84d38960608f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:21.707882 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-eb9d5334-f75c-472d-8277-84d38960608f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:21.730803 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-3556bf97-a706-4bbf-9cdf-b2edd4d2397f tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28160 microversion: 2.1 time: 0.076185 Oct 19 08:33:21.732882 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 643/1291] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:21 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28160 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:21.774874 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-eb9d5334-f75c-472d-8277-84d38960608f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28631 microversion: 2.20 time: 0.080346 Oct 19 08:33:21.775486 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 649/1292] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:21 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28631 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:33:22.742926 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-a30180c6-7d2f-49e4-8b49-df93a46a01c3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:22.743853 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-a30180c6-7d2f-49e4-8b49-df93a46a01c3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:22.750529 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a30180c6-7d2f-49e4-8b49-df93a46a01c3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:22.750965 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a30180c6-7d2f-49e4-8b49-df93a46a01c3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:22.751714 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a30180c6-7d2f-49e4-8b49-df93a46a01c3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:22.752137 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a30180c6-7d2f-49e4-8b49-df93a46a01c3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:22.786860 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-2b35219a-b7d3-40a4-ad6c-6a9998dad3c0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:22.787841 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-2b35219a-b7d3-40a4-ad6c-6a9998dad3c0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:22.794270 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2b35219a-b7d3-40a4-ad6c-6a9998dad3c0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:22.794751 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2b35219a-b7d3-40a4-ad6c-6a9998dad3c0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:22.795500 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2b35219a-b7d3-40a4-ad6c-6a9998dad3c0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:22.795922 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2b35219a-b7d3-40a4-ad6c-6a9998dad3c0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:22.818369 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-a30180c6-7d2f-49e4-8b49-df93a46a01c3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28160 microversion: 2.1 time: 0.079381 Oct 19 08:33:22.819262 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 644/1293] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:22 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28160 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:22.828685 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c3d241cf-00da-41af-8305-d9d615c3f42b tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:22.829771 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-c3d241cf-00da-41af-8305-d9d615c3f42b tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:22.836352 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c3d241cf-00da-41af-8305-d9d615c3f42b tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:22.836791 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c3d241cf-00da-41af-8305-d9d615c3f42b tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:22.837546 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c3d241cf-00da-41af-8305-d9d615c3f42b tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:22.837974 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c3d241cf-00da-41af-8305-d9d615c3f42b tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:22.857830 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-2b35219a-b7d3-40a4-ad6c-6a9998dad3c0 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28631 microversion: 2.20 time: 0.074780 Oct 19 08:33:22.861698 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 650/1294] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:22 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28631 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:33:22.905755 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-c3d241cf-00da-41af-8305-d9d615c3f42b tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "POST /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991/action" status: 202 len: 0 microversion: 2.1 time: 0.080791 Oct 19 08:33:22.906367 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 645/1295] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:22 2021] POST /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:33:22.915405 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a431899f-d11d-4da1-933f-6c9b7e666dde tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:33:22.916096 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a431899f-d11d-4da1-933f-6c9b7e666dde tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:22.923351 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a431899f-d11d-4da1-933f-6c9b7e666dde tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:22.923842 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a431899f-d11d-4da1-933f-6c9b7e666dde tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:22.924640 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a431899f-d11d-4da1-933f-6c9b7e666dde tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:22.925069 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a431899f-d11d-4da1-933f-6c9b7e666dde tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:23.110285 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a431899f-d11d-4da1-933f-6c9b7e666dde tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:23.118777 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a431899f-d11d-4da1-933f-6c9b7e666dde tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1753 microversion: 2.1 time: 0.207571 Oct 19 08:33:23.130440 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 651/1296] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:33:22 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1753 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:33:23.830586 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-13055093-88d6-4b6f-9a4f-f816557cd315 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:23.831582 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-13055093-88d6-4b6f-9a4f-f816557cd315 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:23.837932 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-13055093-88d6-4b6f-9a4f-f816557cd315 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:23.838884 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-13055093-88d6-4b6f-9a4f-f816557cd315 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:23.839647 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-13055093-88d6-4b6f-9a4f-f816557cd315 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:23.840072 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-13055093-88d6-4b6f-9a4f-f816557cd315 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:23.869907 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-91ee7bf4-2c2a-49a4-ac03-1db7a8710950 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:23.870946 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-91ee7bf4-2c2a-49a4-ac03-1db7a8710950 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:23.876657 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-91ee7bf4-2c2a-49a4-ac03-1db7a8710950 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:23.877092 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-91ee7bf4-2c2a-49a4-ac03-1db7a8710950 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:23.877837 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-91ee7bf4-2c2a-49a4-ac03-1db7a8710950 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:23.878253 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-91ee7bf4-2c2a-49a4-ac03-1db7a8710950 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:23.919608 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-13055093-88d6-4b6f-9a4f-f816557cd315 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28160 microversion: 2.1 time: 0.092922 Oct 19 08:33:23.920277 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 646/1297] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:23 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28160 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:23.956361 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-91ee7bf4-2c2a-49a4-ac03-1db7a8710950 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28631 microversion: 2.20 time: 0.090210 Oct 19 08:33:23.956978 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 652/1298] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:23 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28631 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:33:24.139126 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-6b9f2286-193c-4ebd-aa8f-b92ac46ff002 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:33:24.139846 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-6b9f2286-193c-4ebd-aa8f-b92ac46ff002 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:24.146288 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b9f2286-193c-4ebd-aa8f-b92ac46ff002 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:24.146758 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b9f2286-193c-4ebd-aa8f-b92ac46ff002 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:24.147505 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b9f2286-193c-4ebd-aa8f-b92ac46ff002 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:24.147924 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6b9f2286-193c-4ebd-aa8f-b92ac46ff002 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:24.269584 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-6b9f2286-193c-4ebd-aa8f-b92ac46ff002 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:24.277865 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-6b9f2286-193c-4ebd-aa8f-b92ac46ff002 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1758 microversion: 2.1 time: 0.143559 Oct 19 08:33:24.278423 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 647/1299] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:33:24 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1758 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:33:24.932695 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-fab2d1dd-ccc7-4993-82ce-a99120827172 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:24.933686 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-fab2d1dd-ccc7-4993-82ce-a99120827172 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:24.940098 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fab2d1dd-ccc7-4993-82ce-a99120827172 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:24.940535 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fab2d1dd-ccc7-4993-82ce-a99120827172 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:24.941283 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fab2d1dd-ccc7-4993-82ce-a99120827172 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:24.941705 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fab2d1dd-ccc7-4993-82ce-a99120827172 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:24.968866 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-a6d04445-0cd7-47c2-80fc-9dd20fbdc202 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:24.969951 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-a6d04445-0cd7-47c2-80fc-9dd20fbdc202 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:24.975728 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a6d04445-0cd7-47c2-80fc-9dd20fbdc202 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:24.976172 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a6d04445-0cd7-47c2-80fc-9dd20fbdc202 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:24.976913 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a6d04445-0cd7-47c2-80fc-9dd20fbdc202 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:24.977337 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a6d04445-0cd7-47c2-80fc-9dd20fbdc202 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:25.003394 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-fab2d1dd-ccc7-4993-82ce-a99120827172 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28160 microversion: 2.1 time: 0.075163 Oct 19 08:33:25.004059 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 653/1300] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:24 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28160 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:25.043891 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-a6d04445-0cd7-47c2-80fc-9dd20fbdc202 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28631 microversion: 2.20 time: 0.079243 Oct 19 08:33:25.044754 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 648/1301] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:24 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28631 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:33:25.296692 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-34c52b82-0324-4221-a54c-498fb9ff7750 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:33:25.297317 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-34c52b82-0324-4221-a54c-498fb9ff7750 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:25.303571 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-34c52b82-0324-4221-a54c-498fb9ff7750 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:25.304005 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-34c52b82-0324-4221-a54c-498fb9ff7750 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:25.304744 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-34c52b82-0324-4221-a54c-498fb9ff7750 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:25.305162 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-34c52b82-0324-4221-a54c-498fb9ff7750 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:25.429929 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-34c52b82-0324-4221-a54c-498fb9ff7750 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:25.437592 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-34c52b82-0324-4221-a54c-498fb9ff7750 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1758 microversion: 2.1 time: 0.145062 Oct 19 08:33:25.438150 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 654/1302] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:33:25 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1758 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:33:26.016174 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-7975b586-a9fa-4e4b-bec3-ccbd8b2dab91 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:26.017187 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-7975b586-a9fa-4e4b-bec3-ccbd8b2dab91 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:26.023512 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7975b586-a9fa-4e4b-bec3-ccbd8b2dab91 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:26.023952 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7975b586-a9fa-4e4b-bec3-ccbd8b2dab91 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:26.024699 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7975b586-a9fa-4e4b-bec3-ccbd8b2dab91 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:26.025120 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7975b586-a9fa-4e4b-bec3-ccbd8b2dab91 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:26.055349 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-9a35522c-530d-4b9e-9fad-b4b395b94c24 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:26.056259 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-9a35522c-530d-4b9e-9fad-b4b395b94c24 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:26.063261 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9a35522c-530d-4b9e-9fad-b4b395b94c24 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:26.063725 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9a35522c-530d-4b9e-9fad-b4b395b94c24 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:26.064493 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9a35522c-530d-4b9e-9fad-b4b395b94c24 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:26.064911 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9a35522c-530d-4b9e-9fad-b4b395b94c24 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:26.101593 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-7975b586-a9fa-4e4b-bec3-ccbd8b2dab91 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28160 microversion: 2.1 time: 0.089560 Oct 19 08:33:26.102301 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 649/1303] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:26 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28160 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:26.131696 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-9a35522c-530d-4b9e-9fad-b4b395b94c24 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28631 microversion: 2.20 time: 0.079798 Oct 19 08:33:26.134631 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 655/1304] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:26 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28631 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:33:26.454902 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-56440181-491d-4b5e-8444-f8802267b110 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:33:26.455593 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-56440181-491d-4b5e-8444-f8802267b110 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:26.462172 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-56440181-491d-4b5e-8444-f8802267b110 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:26.462651 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-56440181-491d-4b5e-8444-f8802267b110 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:26.464081 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-56440181-491d-4b5e-8444-f8802267b110 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:26.464627 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-56440181-491d-4b5e-8444-f8802267b110 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:26.586858 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-56440181-491d-4b5e-8444-f8802267b110 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:26.594899 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-56440181-491d-4b5e-8444-f8802267b110 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1758 microversion: 2.1 time: 0.144040 Oct 19 08:33:26.595449 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 650/1305] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:33:26 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1758 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:33:27.113567 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-58dd40dd-7501-44a7-b466-cd8f892f4876 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:27.114597 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-58dd40dd-7501-44a7-b466-cd8f892f4876 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:27.121067 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-58dd40dd-7501-44a7-b466-cd8f892f4876 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:27.121506 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-58dd40dd-7501-44a7-b466-cd8f892f4876 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:27.122254 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-58dd40dd-7501-44a7-b466-cd8f892f4876 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:27.122716 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-58dd40dd-7501-44a7-b466-cd8f892f4876 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:27.143273 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c36a2e9d-9594-4a8b-8ae6-867c9e9d6714 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:27.144180 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-c36a2e9d-9594-4a8b-8ae6-867c9e9d6714 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:27.150022 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c36a2e9d-9594-4a8b-8ae6-867c9e9d6714 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:27.150470 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c36a2e9d-9594-4a8b-8ae6-867c9e9d6714 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:27.151893 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c36a2e9d-9594-4a8b-8ae6-867c9e9d6714 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:27.152326 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c36a2e9d-9594-4a8b-8ae6-867c9e9d6714 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:27.183321 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-58dd40dd-7501-44a7-b466-cd8f892f4876 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28160 microversion: 2.1 time: 0.073563 Oct 19 08:33:27.183983 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 656/1306] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:27 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28160 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:27.217815 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-c36a2e9d-9594-4a8b-8ae6-867c9e9d6714 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 28631 microversion: 2.20 time: 0.078002 Oct 19 08:33:27.218643 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 651/1307] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:27 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 28631 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:33:27.612370 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-37996f91-9850-42dd-ad25-aedcaa9f7574 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:33:27.613057 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-37996f91-9850-42dd-ad25-aedcaa9f7574 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:27.619997 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-37996f91-9850-42dd-ad25-aedcaa9f7574 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:27.620437 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-37996f91-9850-42dd-ad25-aedcaa9f7574 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:27.621188 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-37996f91-9850-42dd-ad25-aedcaa9f7574 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:27.621613 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-37996f91-9850-42dd-ad25-aedcaa9f7574 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:27.746423 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-37996f91-9850-42dd-ad25-aedcaa9f7574 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:27.754046 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-37996f91-9850-42dd-ad25-aedcaa9f7574 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1758 microversion: 2.1 time: 0.145711 Oct 19 08:33:27.754635 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 657/1308] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:33:27 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1758 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:33:28.195501 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-0b4be3d2-8bfb-4b94-9a86-39933983a870 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:28.196495 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-0b4be3d2-8bfb-4b94-9a86-39933983a870 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:28.202884 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0b4be3d2-8bfb-4b94-9a86-39933983a870 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:28.203334 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0b4be3d2-8bfb-4b94-9a86-39933983a870 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:28.204089 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0b4be3d2-8bfb-4b94-9a86-39933983a870 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:28.204520 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0b4be3d2-8bfb-4b94-9a86-39933983a870 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:28.229583 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3222d75a-fca3-4e9c-8f3a-d472a7fac957 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:28.230536 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3222d75a-fca3-4e9c-8f3a-d472a7fac957 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:28.236314 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3222d75a-fca3-4e9c-8f3a-d472a7fac957 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:28.236758 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3222d75a-fca3-4e9c-8f3a-d472a7fac957 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:28.237517 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3222d75a-fca3-4e9c-8f3a-d472a7fac957 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:28.237945 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3222d75a-fca3-4e9c-8f3a-d472a7fac957 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:28.272415 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-0b4be3d2-8bfb-4b94-9a86-39933983a870 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28160 microversion: 2.1 time: 0.080816 Oct 19 08:33:28.273090 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 652/1309] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:28 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28160 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:28.324183 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3222d75a-fca3-4e9c-8f3a-d472a7fac957 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 30015 microversion: 2.20 time: 0.098662 Oct 19 08:33:28.324830 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 658/1310] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:28 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 30015 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:33:28.771722 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-bca77f5d-0f20-4805-89b5-e1bc13966a66 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:33:28.772409 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-bca77f5d-0f20-4805-89b5-e1bc13966a66 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:28.779941 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bca77f5d-0f20-4805-89b5-e1bc13966a66 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:28.780380 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bca77f5d-0f20-4805-89b5-e1bc13966a66 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:28.781133 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bca77f5d-0f20-4805-89b5-e1bc13966a66 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:28.781564 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bca77f5d-0f20-4805-89b5-e1bc13966a66 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:28.901965 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-bca77f5d-0f20-4805-89b5-e1bc13966a66 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:28.909611 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-bca77f5d-0f20-4805-89b5-e1bc13966a66 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1758 microversion: 2.1 time: 0.141902 Oct 19 08:33:28.910161 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 653/1311] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:33:28 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1758 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:33:29.285214 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-bf08c94c-c886-421a-b24e-fe71da4f80e3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:29.286364 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-bf08c94c-c886-421a-b24e-fe71da4f80e3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:29.295829 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bf08c94c-c886-421a-b24e-fe71da4f80e3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:29.296309 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bf08c94c-c886-421a-b24e-fe71da4f80e3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:29.297060 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bf08c94c-c886-421a-b24e-fe71da4f80e3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:29.297483 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bf08c94c-c886-421a-b24e-fe71da4f80e3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:29.334827 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-defa0f71-a23b-41d3-91c2-337bb06a9310 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:29.335755 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-defa0f71-a23b-41d3-91c2-337bb06a9310 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:29.341825 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-defa0f71-a23b-41d3-91c2-337bb06a9310 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:29.342268 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-defa0f71-a23b-41d3-91c2-337bb06a9310 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:29.343117 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-defa0f71-a23b-41d3-91c2-337bb06a9310 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:29.343545 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-defa0f71-a23b-41d3-91c2-337bb06a9310 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:29.362434 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-bf08c94c-c886-421a-b24e-fe71da4f80e3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28160 microversion: 2.1 time: 0.081230 Oct 19 08:33:29.363121 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 659/1312] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:29 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28160 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:29.418519 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-defa0f71-a23b-41d3-91c2-337bb06a9310 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 31960 microversion: 2.20 time: 0.087193 Oct 19 08:33:29.419385 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 654/1313] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:29 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 31960 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:33:29.926263 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-06e99a43-40dc-4ba0-943c-5dc8cfd50176 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:33:29.926985 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-06e99a43-40dc-4ba0-943c-5dc8cfd50176 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:29.933402 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-06e99a43-40dc-4ba0-943c-5dc8cfd50176 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:29.933845 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-06e99a43-40dc-4ba0-943c-5dc8cfd50176 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:29.934629 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-06e99a43-40dc-4ba0-943c-5dc8cfd50176 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:29.935060 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-06e99a43-40dc-4ba0-943c-5dc8cfd50176 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:30.055527 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-06e99a43-40dc-4ba0-943c-5dc8cfd50176 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:30.063432 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-06e99a43-40dc-4ba0-943c-5dc8cfd50176 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1758 microversion: 2.1 time: 0.141165 Oct 19 08:33:30.063982 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 660/1314] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:33:29 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1758 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:33:30.375245 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-022446ed-c7dc-4750-ae01-9452ad6a5896 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:30.376235 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-022446ed-c7dc-4750-ae01-9452ad6a5896 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:30.382720 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-022446ed-c7dc-4750-ae01-9452ad6a5896 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:30.383170 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-022446ed-c7dc-4750-ae01-9452ad6a5896 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:30.383933 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-022446ed-c7dc-4750-ae01-9452ad6a5896 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:30.384366 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-022446ed-c7dc-4750-ae01-9452ad6a5896 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:30.429767 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-bb870309-01ca-4bdb-857e-5990f8131ba5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:30.430708 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-bb870309-01ca-4bdb-857e-5990f8131ba5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:30.437038 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bb870309-01ca-4bdb-857e-5990f8131ba5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:30.437479 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bb870309-01ca-4bdb-857e-5990f8131ba5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:30.438229 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bb870309-01ca-4bdb-857e-5990f8131ba5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:30.438690 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bb870309-01ca-4bdb-857e-5990f8131ba5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:30.463122 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-022446ed-c7dc-4750-ae01-9452ad6a5896 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28160 microversion: 2.1 time: 0.091775 Oct 19 08:33:30.463903 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 655/1315] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:30 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28160 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:30.513318 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-bb870309-01ca-4bdb-857e-5990f8131ba5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 33316 microversion: 2.20 time: 0.086877 Oct 19 08:33:30.513919 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 661/1316] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:30 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 33316 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:33:31.081401 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-387a5057-2208-4221-b05a-f3f56d68557f tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:33:31.082119 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-387a5057-2208-4221-b05a-f3f56d68557f tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:31.089037 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-387a5057-2208-4221-b05a-f3f56d68557f tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:31.089481 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-387a5057-2208-4221-b05a-f3f56d68557f tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:31.090242 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-387a5057-2208-4221-b05a-f3f56d68557f tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:31.090713 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-387a5057-2208-4221-b05a-f3f56d68557f tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:31.215588 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-387a5057-2208-4221-b05a-f3f56d68557f tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:31.223221 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-387a5057-2208-4221-b05a-f3f56d68557f tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1758 microversion: 2.1 time: 0.145867 Oct 19 08:33:31.223778 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 656/1317] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:33:31 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1758 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:33:31.474575 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3de42e05-072f-4a8e-9b01-19bb08773978 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:31.475576 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3de42e05-072f-4a8e-9b01-19bb08773978 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:31.482267 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3de42e05-072f-4a8e-9b01-19bb08773978 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:31.482770 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3de42e05-072f-4a8e-9b01-19bb08773978 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:31.483531 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3de42e05-072f-4a8e-9b01-19bb08773978 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:31.483959 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3de42e05-072f-4a8e-9b01-19bb08773978 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:31.525055 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-17e464b6-c071-4c29-961a-7edb98fae851 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:31.526823 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-17e464b6-c071-4c29-961a-7edb98fae851 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:31.532521 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-17e464b6-c071-4c29-961a-7edb98fae851 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:31.532960 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-17e464b6-c071-4c29-961a-7edb98fae851 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:31.533715 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-17e464b6-c071-4c29-961a-7edb98fae851 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:31.534150 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-17e464b6-c071-4c29-961a-7edb98fae851 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:31.553937 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3de42e05-072f-4a8e-9b01-19bb08773978 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28160 microversion: 2.1 time: 0.083244 Oct 19 08:33:31.554816 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 662/1318] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:31 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28160 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:31.608127 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-17e464b6-c071-4c29-961a-7edb98fae851 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 34052 microversion: 2.20 time: 0.086655 Oct 19 08:33:31.609010 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 657/1319] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:31 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 34052 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:33:32.241183 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-75afab28-4e18-4dbe-9f56-eca06f4ffb60 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:33:32.241864 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-75afab28-4e18-4dbe-9f56-eca06f4ffb60 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:32.249140 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-75afab28-4e18-4dbe-9f56-eca06f4ffb60 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:32.249641 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-75afab28-4e18-4dbe-9f56-eca06f4ffb60 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:32.250384 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-75afab28-4e18-4dbe-9f56-eca06f4ffb60 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:32.250912 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-75afab28-4e18-4dbe-9f56-eca06f4ffb60 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:32.371286 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-75afab28-4e18-4dbe-9f56-eca06f4ffb60 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:32.378996 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-75afab28-4e18-4dbe-9f56-eca06f4ffb60 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1758 microversion: 2.1 time: 0.141819 Oct 19 08:33:32.379555 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 663/1320] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:33:32 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1758 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:33:32.565972 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-1209d6b6-1475-4a73-aedf-7b90eb3af57a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:32.566892 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-1209d6b6-1475-4a73-aedf-7b90eb3af57a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:32.573239 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1209d6b6-1475-4a73-aedf-7b90eb3af57a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:32.573678 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1209d6b6-1475-4a73-aedf-7b90eb3af57a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:32.574429 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1209d6b6-1475-4a73-aedf-7b90eb3af57a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:32.574877 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1209d6b6-1475-4a73-aedf-7b90eb3af57a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:32.619730 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-467e57ea-e771-42fd-83ed-1b1655447549 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:32.620716 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-467e57ea-e771-42fd-83ed-1b1655447549 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:32.626401 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-467e57ea-e771-42fd-83ed-1b1655447549 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:32.626864 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-467e57ea-e771-42fd-83ed-1b1655447549 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:32.627607 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-467e57ea-e771-42fd-83ed-1b1655447549 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:32.628024 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-467e57ea-e771-42fd-83ed-1b1655447549 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:32.633372 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-1209d6b6-1475-4a73-aedf-7b90eb3af57a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28160 microversion: 2.1 time: 0.071295 Oct 19 08:33:32.634218 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 658/1321] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:32 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28160 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:33:32.699550 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-467e57ea-e771-42fd-83ed-1b1655447549 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 35238 microversion: 2.20 time: 0.083492 Oct 19 08:33:32.700162 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 664/1322] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:32 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 35238 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:33:33.397654 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-5e656471-b09f-40c4-aee3-f50789afeec9 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:33:33.398332 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-5e656471-b09f-40c4-aee3-f50789afeec9 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:33.405514 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5e656471-b09f-40c4-aee3-f50789afeec9 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:33.405514 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5e656471-b09f-40c4-aee3-f50789afeec9 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:33.406263 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5e656471-b09f-40c4-aee3-f50789afeec9 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:33.406793 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5e656471-b09f-40c4-aee3-f50789afeec9 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:33.528176 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-5e656471-b09f-40c4-aee3-f50789afeec9 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:33.535768 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-5e656471-b09f-40c4-aee3-f50789afeec9 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1758 microversion: 2.1 time: 0.142126 Oct 19 08:33:33.536322 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 659/1323] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:33:33 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1758 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:33:33.645291 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-570424da-7aa7-4de7-bac2-199acf48a7a4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:33.646270 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-570424da-7aa7-4de7-bac2-199acf48a7a4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:33.652824 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-570424da-7aa7-4de7-bac2-199acf48a7a4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:33.653196 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-570424da-7aa7-4de7-bac2-199acf48a7a4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:33.653935 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-570424da-7aa7-4de7-bac2-199acf48a7a4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:33.654353 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-570424da-7aa7-4de7-bac2-199acf48a7a4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:33.711078 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-066625a9-5e92-448c-8dfa-57327cbcaa15 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:33.711990 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-066625a9-5e92-448c-8dfa-57327cbcaa15 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:33.717840 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-066625a9-5e92-448c-8dfa-57327cbcaa15 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:33.718286 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-066625a9-5e92-448c-8dfa-57327cbcaa15 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:33.719085 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-066625a9-5e92-448c-8dfa-57327cbcaa15 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:33.719521 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-066625a9-5e92-448c-8dfa-57327cbcaa15 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:33.727805 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-570424da-7aa7-4de7-bac2-199acf48a7a4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28451 microversion: 2.1 time: 0.086260 Oct 19 08:33:33.729255 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 665/1324] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:33 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28451 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:33.794354 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-066625a9-5e92-448c-8dfa-57327cbcaa15 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 36558 microversion: 2.20 time: 0.086734 Oct 19 08:33:33.794916 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 660/1325] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:33 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 36558 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:33:34.553411 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a69d9b19-3d54-4aed-a347-444603a06b70 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:33:34.554095 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a69d9b19-3d54-4aed-a347-444603a06b70 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:34.560680 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a69d9b19-3d54-4aed-a347-444603a06b70 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:34.561119 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a69d9b19-3d54-4aed-a347-444603a06b70 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:34.561869 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a69d9b19-3d54-4aed-a347-444603a06b70 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:34.562292 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a69d9b19-3d54-4aed-a347-444603a06b70 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:34.686125 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a69d9b19-3d54-4aed-a347-444603a06b70 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:34.693676 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a69d9b19-3d54-4aed-a347-444603a06b70 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1761 microversion: 2.1 time: 0.144319 Oct 19 08:33:34.694232 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 666/1326] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:33:34 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1761 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:33:34.740042 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-b041f7cd-61bc-434b-a7b6-20d07c6f7d5d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:34.741017 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-b041f7cd-61bc-434b-a7b6-20d07c6f7d5d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:34.747544 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b041f7cd-61bc-434b-a7b6-20d07c6f7d5d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:34.747986 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b041f7cd-61bc-434b-a7b6-20d07c6f7d5d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:34.748731 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b041f7cd-61bc-434b-a7b6-20d07c6f7d5d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:34.749150 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b041f7cd-61bc-434b-a7b6-20d07c6f7d5d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:34.805699 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e2be9e86-b7b4-41bc-9834-56b471d78770 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:34.807109 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e2be9e86-b7b4-41bc-9834-56b471d78770 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:34.813165 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e2be9e86-b7b4-41bc-9834-56b471d78770 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:34.813409 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-b041f7cd-61bc-434b-a7b6-20d07c6f7d5d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28451 microversion: 2.1 time: 0.077107 Oct 19 08:33:34.813601 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e2be9e86-b7b4-41bc-9834-56b471d78770 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:34.814249 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 661/1327] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:34 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28451 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:34.814419 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e2be9e86-b7b4-41bc-9834-56b471d78770 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:34.814939 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e2be9e86-b7b4-41bc-9834-56b471d78770 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:34.888805 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e2be9e86-b7b4-41bc-9834-56b471d78770 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 37886 microversion: 2.20 time: 0.086535 Oct 19 08:33:34.889407 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 667/1328] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:34 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 37886 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:33:35.825329 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d4f457e9-e802-4949-80da-f6ecf6c6bcbd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:35.826321 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-d4f457e9-e802-4949-80da-f6ecf6c6bcbd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:35.833260 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d4f457e9-e802-4949-80da-f6ecf6c6bcbd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:35.833703 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d4f457e9-e802-4949-80da-f6ecf6c6bcbd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:35.834472 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d4f457e9-e802-4949-80da-f6ecf6c6bcbd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:35.834933 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d4f457e9-e802-4949-80da-f6ecf6c6bcbd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:35.901369 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-aac6ccbf-d499-46d2-ae60-832d7fda27aa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:35.902380 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-aac6ccbf-d499-46d2-ae60-832d7fda27aa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:35.908812 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-aac6ccbf-d499-46d2-ae60-832d7fda27aa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:35.909250 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-aac6ccbf-d499-46d2-ae60-832d7fda27aa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:35.910005 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-aac6ccbf-d499-46d2-ae60-832d7fda27aa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:35.910431 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-aac6ccbf-d499-46d2-ae60-832d7fda27aa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:35.911894 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-d4f457e9-e802-4949-80da-f6ecf6c6bcbd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28619 microversion: 2.1 time: 0.090454 Oct 19 08:33:35.913397 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 662/1329] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:35 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28619 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:36.142318 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-aac6ccbf-d499-46d2-ae60-832d7fda27aa tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 38189 microversion: 2.20 time: 0.245511 Oct 19 08:33:36.142962 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 668/1330] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:35 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 38189 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:33:36.924010 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-93052325-28e6-45f8-a563-c79971a8d952 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:36.924998 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-93052325-28e6-45f8-a563-c79971a8d952 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:36.931352 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-93052325-28e6-45f8-a563-c79971a8d952 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:36.932444 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-93052325-28e6-45f8-a563-c79971a8d952 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:36.933196 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-93052325-28e6-45f8-a563-c79971a8d952 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:36.933628 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-93052325-28e6-45f8-a563-c79971a8d952 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:36.992889 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-93052325-28e6-45f8-a563-c79971a8d952 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28619 microversion: 2.1 time: 0.072725 Oct 19 08:33:36.993508 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 663/1331] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:36 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28619 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:37.154115 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3f66ba61-13f7-4e25-8c24-12c62832f263 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:37.155121 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3f66ba61-13f7-4e25-8c24-12c62832f263 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:37.161437 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3f66ba61-13f7-4e25-8c24-12c62832f263 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:37.161875 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3f66ba61-13f7-4e25-8c24-12c62832f263 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:37.162649 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3f66ba61-13f7-4e25-8c24-12c62832f263 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:37.163069 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3f66ba61-13f7-4e25-8c24-12c62832f263 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:37.239523 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3f66ba61-13f7-4e25-8c24-12c62832f263 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 38189 microversion: 2.20 time: 0.089850 Oct 19 08:33:37.240050 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 669/1332] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:37 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 38189 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:33:38.005491 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-1a59e818-b3cb-4b82-9109-833c573e218a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:38.006472 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-1a59e818-b3cb-4b82-9109-833c573e218a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:38.014141 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1a59e818-b3cb-4b82-9109-833c573e218a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:38.014610 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1a59e818-b3cb-4b82-9109-833c573e218a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:38.015363 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1a59e818-b3cb-4b82-9109-833c573e218a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:38.015784 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-1a59e818-b3cb-4b82-9109-833c573e218a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:38.076463 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-1a59e818-b3cb-4b82-9109-833c573e218a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28619 microversion: 2.1 time: 0.074832 Oct 19 08:33:38.077066 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 664/1333] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:38 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28619 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:38.251702 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-f920a8ee-86d3-4791-a1fa-7c95964145a5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:38.252729 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-f920a8ee-86d3-4791-a1fa-7c95964145a5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:38.259183 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f920a8ee-86d3-4791-a1fa-7c95964145a5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:38.259628 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f920a8ee-86d3-4791-a1fa-7c95964145a5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:38.260420 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f920a8ee-86d3-4791-a1fa-7c95964145a5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:38.260847 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f920a8ee-86d3-4791-a1fa-7c95964145a5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:38.320532 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-f920a8ee-86d3-4791-a1fa-7c95964145a5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 38189 microversion: 2.20 time: 0.072719 Oct 19 08:33:38.321139 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 670/1334] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:38 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 38189 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:33:39.088524 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c8f624fb-38bf-42ad-a5f4-e31432cfce13 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:39.089508 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-c8f624fb-38bf-42ad-a5f4-e31432cfce13 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:39.095899 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c8f624fb-38bf-42ad-a5f4-e31432cfce13 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:39.096341 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c8f624fb-38bf-42ad-a5f4-e31432cfce13 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:39.097096 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c8f624fb-38bf-42ad-a5f4-e31432cfce13 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:39.097522 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c8f624fb-38bf-42ad-a5f4-e31432cfce13 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:39.167386 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-c8f624fb-38bf-42ad-a5f4-e31432cfce13 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28619 microversion: 2.1 time: 0.082835 Oct 19 08:33:39.167990 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 665/1335] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:39 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28619 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:39.332868 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-f25f7aee-905b-4b13-849d-dc718f90c20e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:39.333863 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-f25f7aee-905b-4b13-849d-dc718f90c20e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:39.340891 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f25f7aee-905b-4b13-849d-dc718f90c20e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:39.341270 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f25f7aee-905b-4b13-849d-dc718f90c20e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:39.342029 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f25f7aee-905b-4b13-849d-dc718f90c20e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:39.342455 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f25f7aee-905b-4b13-849d-dc718f90c20e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:39.414101 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-f25f7aee-905b-4b13-849d-dc718f90c20e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 200 len: 38332 microversion: 2.20 time: 0.085103 Oct 19 08:33:39.414770 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 671/1336] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:39 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 38332 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:33:39.425770 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-ec0c7dbc-9462-4e4e-8d8f-c6f479110996 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:33:39.426337 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-ec0c7dbc-9462-4e4e-8d8f-c6f479110996 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:39.433173 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ec0c7dbc-9462-4e4e-8d8f-c6f479110996 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:39.433612 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ec0c7dbc-9462-4e4e-8d8f-c6f479110996 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:39.434360 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ec0c7dbc-9462-4e4e-8d8f-c6f479110996 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:39.434814 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ec0c7dbc-9462-4e4e-8d8f-c6f479110996 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:39.457194 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-ec0c7dbc-9462-4e4e-8d8f-c6f479110996 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/ips" status: 200 len: 152 microversion: 2.20 time: 0.035478 Oct 19 08:33:39.457747 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 666/1337] 10.222.0.26 () {60 vars in 1288 bytes} [Tue Oct 19 08:33:39 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:40.179488 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-91ecd744-6e7e-47c6-83c0-b2e3fe0abd81 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:40.180423 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-91ecd744-6e7e-47c6-83c0-b2e3fe0abd81 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:40.187524 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-91ecd744-6e7e-47c6-83c0-b2e3fe0abd81 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:40.187961 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-91ecd744-6e7e-47c6-83c0-b2e3fe0abd81 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:40.188710 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-91ecd744-6e7e-47c6-83c0-b2e3fe0abd81 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:40.189131 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-91ecd744-6e7e-47c6-83c0-b2e3fe0abd81 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:40.252076 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-91ecd744-6e7e-47c6-83c0-b2e3fe0abd81 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28619 microversion: 2.1 time: 0.076604 Oct 19 08:33:40.252673 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 672/1338] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:40 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28619 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:41.263430 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-5675defb-76ce-416f-80a0-40c7c9f87662 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:41.264335 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-5675defb-76ce-416f-80a0-40c7c9f87662 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:41.270823 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5675defb-76ce-416f-80a0-40c7c9f87662 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:41.271269 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5675defb-76ce-416f-80a0-40c7c9f87662 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:41.272026 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5675defb-76ce-416f-80a0-40c7c9f87662 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:41.272452 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5675defb-76ce-416f-80a0-40c7c9f87662 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:41.333470 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-5675defb-76ce-416f-80a0-40c7c9f87662 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28619 microversion: 2.1 time: 0.073923 Oct 19 08:33:41.334083 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 667/1339] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:41 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28619 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:41.655162 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c095b54c-7fbc-41a8-9247-107c46abdec5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:41.655776 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c095b54c-7fbc-41a8-9247-107c46abdec5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:41.662164 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c095b54c-7fbc-41a8-9247-107c46abdec5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:41.662643 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c095b54c-7fbc-41a8-9247-107c46abdec5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:41.663398 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c095b54c-7fbc-41a8-9247-107c46abdec5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:41.663821 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c095b54c-7fbc-41a8-9247-107c46abdec5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:41.686773 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.objects.instance [None req-c095b54c-7fbc-41a8-9247-107c46abdec5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lazy-loading 'flavor' on Instance uuid 15322fb9-3685-4ce3-9f4d-9a407835f47a {{(pid=114106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 19 08:33:41.939605 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c095b54c-7fbc-41a8-9247-107c46abdec5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 202 len: 0 microversion: 2.20 time: 0.288972 Oct 19 08:33:41.940213 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 673/1340] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:33:41 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 08:33:41.949892 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-b18cb7fe-d141-423a-ab5b-a9eda1fc1014 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:33:41.950604 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-b18cb7fe-d141-423a-ab5b-a9eda1fc1014 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:41.957093 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b18cb7fe-d141-423a-ab5b-a9eda1fc1014 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:41.957574 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b18cb7fe-d141-423a-ab5b-a9eda1fc1014 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:41.958301 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b18cb7fe-d141-423a-ab5b-a9eda1fc1014 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:41.958763 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b18cb7fe-d141-423a-ab5b-a9eda1fc1014 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:42.080586 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-b18cb7fe-d141-423a-ab5b-a9eda1fc1014 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:42.088799 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-b18cb7fe-d141-423a-ab5b-a9eda1fc1014 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:42.090278 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-b18cb7fe-d141-423a-ab5b-a9eda1fc1014 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:42.091597 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-b18cb7fe-d141-423a-ab5b-a9eda1fc1014 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1724 microversion: 2.20 time: 0.146855 Oct 19 08:33:42.092135 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 668/1341] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:33:41 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:33:42.344513 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a4bd1627-80f9-4f55-a81a-729d964e83ec tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:42.345529 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a4bd1627-80f9-4f55-a81a-729d964e83ec tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:42.351626 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a4bd1627-80f9-4f55-a81a-729d964e83ec tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:42.352065 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a4bd1627-80f9-4f55-a81a-729d964e83ec tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:42.352812 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a4bd1627-80f9-4f55-a81a-729d964e83ec tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:42.353237 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a4bd1627-80f9-4f55-a81a-729d964e83ec tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:42.415220 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a4bd1627-80f9-4f55-a81a-729d964e83ec tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28619 microversion: 2.1 time: 0.074534 Oct 19 08:33:42.415844 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 674/1342] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:42 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28619 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:43.110414 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-9d81e129-570b-4cd2-9259-625c8712a593 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:33:43.111038 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-9d81e129-570b-4cd2-9259-625c8712a593 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:43.117303 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9d81e129-570b-4cd2-9259-625c8712a593 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:43.117744 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9d81e129-570b-4cd2-9259-625c8712a593 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:43.118513 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9d81e129-570b-4cd2-9259-625c8712a593 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:43.118956 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9d81e129-570b-4cd2-9259-625c8712a593 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:43.237418 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-9d81e129-570b-4cd2-9259-625c8712a593 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:43.245074 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-9d81e129-570b-4cd2-9259-625c8712a593 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:43.246581 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-9d81e129-570b-4cd2-9259-625c8712a593 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:43.247730 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-9d81e129-570b-4cd2-9259-625c8712a593 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1724 microversion: 2.20 time: 0.141007 Oct 19 08:33:43.248286 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 669/1343] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:33:43 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1724 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:33:43.427344 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-346d845d-1398-4ff6-8913-da81d34e8bea tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:43.428380 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-346d845d-1398-4ff6-8913-da81d34e8bea tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:43.435304 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-346d845d-1398-4ff6-8913-da81d34e8bea tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:43.435742 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-346d845d-1398-4ff6-8913-da81d34e8bea tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:43.436487 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-346d845d-1398-4ff6-8913-da81d34e8bea tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:43.436911 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-346d845d-1398-4ff6-8913-da81d34e8bea tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:43.496719 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-346d845d-1398-4ff6-8913-da81d34e8bea tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28619 microversion: 2.1 time: 0.073272 Oct 19 08:33:43.497327 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 675/1344] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:43 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28619 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:44.265950 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-13583d70-1934-4760-9824-af9c8ea356ed tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:33:44.266577 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-13583d70-1934-4760-9824-af9c8ea356ed tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:44.272466 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-13583d70-1934-4760-9824-af9c8ea356ed tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:44.272911 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-13583d70-1934-4760-9824-af9c8ea356ed tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:44.273672 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-13583d70-1934-4760-9824-af9c8ea356ed tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:44.274104 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-13583d70-1934-4760-9824-af9c8ea356ed tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:44.397124 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-13583d70-1934-4760-9824-af9c8ea356ed tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:44.404975 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-13583d70-1934-4760-9824-af9c8ea356ed tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:44.406470 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-13583d70-1934-4760-9824-af9c8ea356ed tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:44.407645 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-13583d70-1934-4760-9824-af9c8ea356ed tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1724 microversion: 2.20 time: 0.145779 Oct 19 08:33:44.408200 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 670/1345] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:33:44 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:33:44.508612 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-eeceb0fc-6fd6-4e4d-9226-6052e0396ef3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:44.509618 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-eeceb0fc-6fd6-4e4d-9226-6052e0396ef3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:44.516343 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-eeceb0fc-6fd6-4e4d-9226-6052e0396ef3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:44.516720 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-eeceb0fc-6fd6-4e4d-9226-6052e0396ef3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:44.517468 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-eeceb0fc-6fd6-4e4d-9226-6052e0396ef3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:44.517890 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-eeceb0fc-6fd6-4e4d-9226-6052e0396ef3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:44.580015 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-eeceb0fc-6fd6-4e4d-9226-6052e0396ef3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28619 microversion: 2.1 time: 0.075240 Oct 19 08:33:44.580607 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 676/1346] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:44 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28619 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:45.426178 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-76532d29-dc6b-48f4-8906-3ac27355346a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:33:45.426797 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-76532d29-dc6b-48f4-8906-3ac27355346a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:45.433353 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-76532d29-dc6b-48f4-8906-3ac27355346a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:45.433795 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-76532d29-dc6b-48f4-8906-3ac27355346a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:45.434737 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-76532d29-dc6b-48f4-8906-3ac27355346a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:45.435168 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-76532d29-dc6b-48f4-8906-3ac27355346a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:45.552658 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-76532d29-dc6b-48f4-8906-3ac27355346a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:45.560405 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-76532d29-dc6b-48f4-8906-3ac27355346a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:45.561870 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-76532d29-dc6b-48f4-8906-3ac27355346a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:45.563022 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-76532d29-dc6b-48f4-8906-3ac27355346a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1724 microversion: 2.20 time: 0.140611 Oct 19 08:33:45.563566 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 671/1347] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:33:45 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1724 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:33:45.592773 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-4758cad0-a6bf-49b1-9391-517d75110a8a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:45.594586 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-4758cad0-a6bf-49b1-9391-517d75110a8a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:45.603133 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4758cad0-a6bf-49b1-9391-517d75110a8a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:45.604198 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4758cad0-a6bf-49b1-9391-517d75110a8a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:45.604968 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4758cad0-a6bf-49b1-9391-517d75110a8a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:45.605392 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4758cad0-a6bf-49b1-9391-517d75110a8a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:45.670643 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-4758cad0-a6bf-49b1-9391-517d75110a8a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28619 microversion: 2.1 time: 0.082372 Oct 19 08:33:45.671408 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 677/1348] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:45 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28619 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:46.580585 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-0025a13f-7985-48a3-ab0f-eedf30ebf05e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:33:46.581185 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-0025a13f-7985-48a3-ab0f-eedf30ebf05e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:46.587024 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0025a13f-7985-48a3-ab0f-eedf30ebf05e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:46.587470 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0025a13f-7985-48a3-ab0f-eedf30ebf05e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:46.589166 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0025a13f-7985-48a3-ab0f-eedf30ebf05e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:46.589600 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0025a13f-7985-48a3-ab0f-eedf30ebf05e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:46.682135 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-dfe25da6-4025-46c1-9c02-22793ed94be2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:46.683389 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-dfe25da6-4025-46c1-9c02-22793ed94be2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:46.689796 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-dfe25da6-4025-46c1-9c02-22793ed94be2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:46.690304 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-dfe25da6-4025-46c1-9c02-22793ed94be2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:46.691158 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-dfe25da6-4025-46c1-9c02-22793ed94be2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:46.691649 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-dfe25da6-4025-46c1-9c02-22793ed94be2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:46.707411 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-0025a13f-7985-48a3-ab0f-eedf30ebf05e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:46.715867 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-0025a13f-7985-48a3-ab0f-eedf30ebf05e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:46.717362 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-0025a13f-7985-48a3-ab0f-eedf30ebf05e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:46.718555 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-0025a13f-7985-48a3-ab0f-eedf30ebf05e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1724 microversion: 2.20 time: 0.141719 Oct 19 08:33:46.719171 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 672/1349] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:33:46 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1724 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:33:46.751488 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-dfe25da6-4025-46c1-9c02-22793ed94be2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28619 microversion: 2.1 time: 0.073382 Oct 19 08:33:46.752097 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 678/1350] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:46 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28619 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:33:47.735532 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-fbbc9994-1b75-44bd-9532-138553c9ea2d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:33:47.736129 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-fbbc9994-1b75-44bd-9532-138553c9ea2d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:47.741900 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fbbc9994-1b75-44bd-9532-138553c9ea2d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:47.742344 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fbbc9994-1b75-44bd-9532-138553c9ea2d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:47.743132 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fbbc9994-1b75-44bd-9532-138553c9ea2d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:47.743561 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fbbc9994-1b75-44bd-9532-138553c9ea2d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:47.762762 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c22481b4-e714-4fbe-b2a1-0450a8f8d7b7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:47.764020 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c22481b4-e714-4fbe-b2a1-0450a8f8d7b7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:47.770485 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c22481b4-e714-4fbe-b2a1-0450a8f8d7b7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:47.770968 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c22481b4-e714-4fbe-b2a1-0450a8f8d7b7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:47.771736 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c22481b4-e714-4fbe-b2a1-0450a8f8d7b7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:47.772165 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c22481b4-e714-4fbe-b2a1-0450a8f8d7b7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:47.837274 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c22481b4-e714-4fbe-b2a1-0450a8f8d7b7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28619 microversion: 2.1 time: 0.078510 Oct 19 08:33:47.838452 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 679/1351] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:47 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28619 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:33:47.868744 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-fbbc9994-1b75-44bd-9532-138553c9ea2d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:47.876601 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-fbbc9994-1b75-44bd-9532-138553c9ea2d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:47.878089 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-fbbc9994-1b75-44bd-9532-138553c9ea2d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:47.879270 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-fbbc9994-1b75-44bd-9532-138553c9ea2d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1724 microversion: 2.20 time: 0.147504 Oct 19 08:33:47.879817 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 673/1352] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:33:47 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:33:48.850353 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-8aa885d6-8916-440b-bfa4-5c013e25b5a8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:48.851411 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-8aa885d6-8916-440b-bfa4-5c013e25b5a8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:48.858652 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8aa885d6-8916-440b-bfa4-5c013e25b5a8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:48.859124 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8aa885d6-8916-440b-bfa4-5c013e25b5a8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:48.859884 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8aa885d6-8916-440b-bfa4-5c013e25b5a8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:48.860315 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8aa885d6-8916-440b-bfa4-5c013e25b5a8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:48.897210 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-0a23e926-479b-4b94-8129-3c690d30d7d1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:33:48.897807 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-0a23e926-479b-4b94-8129-3c690d30d7d1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:48.903743 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0a23e926-479b-4b94-8129-3c690d30d7d1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:48.904185 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0a23e926-479b-4b94-8129-3c690d30d7d1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:48.904943 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0a23e926-479b-4b94-8129-3c690d30d7d1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:48.905371 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0a23e926-479b-4b94-8129-3c690d30d7d1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:48.923981 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-8aa885d6-8916-440b-bfa4-5c013e25b5a8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28619 microversion: 2.1 time: 0.077508 Oct 19 08:33:48.925457 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 680/1353] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:48 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28619 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:49.023706 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-0a23e926-479b-4b94-8129-3c690d30d7d1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:49.031476 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-0a23e926-479b-4b94-8129-3c690d30d7d1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:49.032962 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-0a23e926-479b-4b94-8129-3c690d30d7d1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:49.034124 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-0a23e926-479b-4b94-8129-3c690d30d7d1 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1724 microversion: 2.20 time: 0.140633 Oct 19 08:33:49.034742 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 674/1354] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:33:48 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1724 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:33:49.936690 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-bd0b89f1-e163-49b8-a535-33a9c55c2b1a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:49.937691 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-bd0b89f1-e163-49b8-a535-33a9c55c2b1a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:49.944108 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bd0b89f1-e163-49b8-a535-33a9c55c2b1a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:49.944554 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bd0b89f1-e163-49b8-a535-33a9c55c2b1a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:49.945314 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bd0b89f1-e163-49b8-a535-33a9c55c2b1a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:49.945743 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bd0b89f1-e163-49b8-a535-33a9c55c2b1a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:50.009556 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-bd0b89f1-e163-49b8-a535-33a9c55c2b1a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28619 microversion: 2.1 time: 0.077321 Oct 19 08:33:50.010156 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 681/1355] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:49 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28619 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:50.052469 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-38d3c6ec-35ff-4541-a563-e0924dd24939 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:33:50.053067 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-38d3c6ec-35ff-4541-a563-e0924dd24939 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:50.059980 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-38d3c6ec-35ff-4541-a563-e0924dd24939 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:50.060364 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-38d3c6ec-35ff-4541-a563-e0924dd24939 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:50.061129 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-38d3c6ec-35ff-4541-a563-e0924dd24939 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:50.061559 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-38d3c6ec-35ff-4541-a563-e0924dd24939 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:50.181308 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-38d3c6ec-35ff-4541-a563-e0924dd24939 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:50.189477 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-38d3c6ec-35ff-4541-a563-e0924dd24939 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:50.191010 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-38d3c6ec-35ff-4541-a563-e0924dd24939 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:50.192153 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-38d3c6ec-35ff-4541-a563-e0924dd24939 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1724 microversion: 2.20 time: 0.143312 Oct 19 08:33:50.192703 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 675/1356] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:33:50 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1724 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:33:51.022450 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-53694681-00b1-4a07-868b-cb37d8029fcc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:51.023459 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-53694681-00b1-4a07-868b-cb37d8029fcc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:51.030648 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-53694681-00b1-4a07-868b-cb37d8029fcc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:51.031094 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-53694681-00b1-4a07-868b-cb37d8029fcc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:51.031852 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-53694681-00b1-4a07-868b-cb37d8029fcc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:51.032276 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-53694681-00b1-4a07-868b-cb37d8029fcc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:51.097132 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-53694681-00b1-4a07-868b-cb37d8029fcc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28619 microversion: 2.1 time: 0.078565 Oct 19 08:33:51.097798 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 682/1357] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:51 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28619 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:51.210176 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-71d1e6d3-12c0-4388-ab2d-483f3474f1fd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:33:51.210797 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-71d1e6d3-12c0-4388-ab2d-483f3474f1fd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:51.216775 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-71d1e6d3-12c0-4388-ab2d-483f3474f1fd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:51.217218 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-71d1e6d3-12c0-4388-ab2d-483f3474f1fd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:51.217968 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-71d1e6d3-12c0-4388-ab2d-483f3474f1fd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:51.218395 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-71d1e6d3-12c0-4388-ab2d-483f3474f1fd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:51.339476 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-71d1e6d3-12c0-4388-ab2d-483f3474f1fd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:51.347317 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-71d1e6d3-12c0-4388-ab2d-483f3474f1fd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:51.348864 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-71d1e6d3-12c0-4388-ab2d-483f3474f1fd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:51.350002 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-71d1e6d3-12c0-4388-ab2d-483f3474f1fd tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1724 microversion: 2.20 time: 0.143564 Oct 19 08:33:51.350566 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 676/1358] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:33:51 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1724 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:33:52.109845 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-82c7ad02-9d2e-4d8f-8432-db49a3a5ca02 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:52.110848 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-82c7ad02-9d2e-4d8f-8432-db49a3a5ca02 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:52.117164 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-82c7ad02-9d2e-4d8f-8432-db49a3a5ca02 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:52.117597 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-82c7ad02-9d2e-4d8f-8432-db49a3a5ca02 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:52.118374 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-82c7ad02-9d2e-4d8f-8432-db49a3a5ca02 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:52.118820 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-82c7ad02-9d2e-4d8f-8432-db49a3a5ca02 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:52.180256 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-82c7ad02-9d2e-4d8f-8432-db49a3a5ca02 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28619 microversion: 2.1 time: 0.074483 Oct 19 08:33:52.180878 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 683/1359] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:52 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28619 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:52.368335 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-461990dd-f8a9-461d-93b6-1fffb3a892e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:33:52.368880 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-461990dd-f8a9-461d-93b6-1fffb3a892e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:52.375517 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-461990dd-f8a9-461d-93b6-1fffb3a892e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:52.375967 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-461990dd-f8a9-461d-93b6-1fffb3a892e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:52.376772 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-461990dd-f8a9-461d-93b6-1fffb3a892e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:52.377205 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-461990dd-f8a9-461d-93b6-1fffb3a892e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:52.501027 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-461990dd-f8a9-461d-93b6-1fffb3a892e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:52.508629 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-461990dd-f8a9-461d-93b6-1fffb3a892e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:52.510104 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-461990dd-f8a9-461d-93b6-1fffb3a892e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:52.511402 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-461990dd-f8a9-461d-93b6-1fffb3a892e7 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1724 microversion: 2.20 time: 0.146778 Oct 19 08:33:52.511958 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 677/1360] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:33:52 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:33:53.192892 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-72479dea-0e38-4155-b93a-3119b9f7ed1e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:53.193869 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-72479dea-0e38-4155-b93a-3119b9f7ed1e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:53.200850 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-72479dea-0e38-4155-b93a-3119b9f7ed1e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:53.201282 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-72479dea-0e38-4155-b93a-3119b9f7ed1e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:53.202030 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-72479dea-0e38-4155-b93a-3119b9f7ed1e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:53.202453 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-72479dea-0e38-4155-b93a-3119b9f7ed1e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:53.277635 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-72479dea-0e38-4155-b93a-3119b9f7ed1e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28619 microversion: 2.1 time: 0.088716 Oct 19 08:33:53.278245 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 684/1361] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:53 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28619 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:53.530043 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-958c1c2b-d39d-45a6-bdac-c1e4d53fab66 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:33:53.530661 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-958c1c2b-d39d-45a6-bdac-c1e4d53fab66 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:53.536410 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-958c1c2b-d39d-45a6-bdac-c1e4d53fab66 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:53.536844 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-958c1c2b-d39d-45a6-bdac-c1e4d53fab66 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:53.537588 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-958c1c2b-d39d-45a6-bdac-c1e4d53fab66 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:53.538036 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-958c1c2b-d39d-45a6-bdac-c1e4d53fab66 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:53.655651 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-958c1c2b-d39d-45a6-bdac-c1e4d53fab66 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:53.663172 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-958c1c2b-d39d-45a6-bdac-c1e4d53fab66 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:53.664635 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-958c1c2b-d39d-45a6-bdac-c1e4d53fab66 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:53.665755 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-958c1c2b-d39d-45a6-bdac-c1e4d53fab66 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1745 microversion: 2.20 time: 0.140255 Oct 19 08:33:53.666309 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 678/1362] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:33:53 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1745 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:33:54.289677 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-aa7c4b3a-b7a3-4ede-88f6-94274e77063a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:54.290685 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-aa7c4b3a-b7a3-4ede-88f6-94274e77063a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:54.297681 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-aa7c4b3a-b7a3-4ede-88f6-94274e77063a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:54.298125 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-aa7c4b3a-b7a3-4ede-88f6-94274e77063a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:54.298910 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-aa7c4b3a-b7a3-4ede-88f6-94274e77063a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:54.299341 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-aa7c4b3a-b7a3-4ede-88f6-94274e77063a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:54.366308 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-aa7c4b3a-b7a3-4ede-88f6-94274e77063a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28619 microversion: 2.1 time: 0.080526 Oct 19 08:33:54.366957 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 685/1363] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:54 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28619 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:54.683819 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-14dcdc6d-45a0-43d4-8f71-cf14275d96e5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:33:54.684410 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-14dcdc6d-45a0-43d4-8f71-cf14275d96e5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:54.690300 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-14dcdc6d-45a0-43d4-8f71-cf14275d96e5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:54.690769 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-14dcdc6d-45a0-43d4-8f71-cf14275d96e5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:54.691519 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-14dcdc6d-45a0-43d4-8f71-cf14275d96e5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:54.691940 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-14dcdc6d-45a0-43d4-8f71-cf14275d96e5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:54.812057 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-14dcdc6d-45a0-43d4-8f71-cf14275d96e5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:54.819531 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-14dcdc6d-45a0-43d4-8f71-cf14275d96e5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:54.820995 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-14dcdc6d-45a0-43d4-8f71-cf14275d96e5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:54.822123 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-14dcdc6d-45a0-43d4-8f71-cf14275d96e5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1745 microversion: 2.20 time: 0.142112 Oct 19 08:33:54.822693 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 679/1364] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:33:54 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1745 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:33:55.378354 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-5149ba0e-ef15-4527-ba08-385667b0f147 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:55.379365 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-5149ba0e-ef15-4527-ba08-385667b0f147 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:55.386598 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5149ba0e-ef15-4527-ba08-385667b0f147 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:55.387043 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5149ba0e-ef15-4527-ba08-385667b0f147 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:55.387797 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5149ba0e-ef15-4527-ba08-385667b0f147 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:55.388214 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5149ba0e-ef15-4527-ba08-385667b0f147 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:55.453401 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-5149ba0e-ef15-4527-ba08-385667b0f147 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28619 microversion: 2.1 time: 0.079009 Oct 19 08:33:55.454008 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 686/1365] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:55 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28619 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:55.840949 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2401b94d-9094-433c-a963-c85832cf219f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:33:55.841557 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2401b94d-9094-433c-a963-c85832cf219f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:55.847383 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2401b94d-9094-433c-a963-c85832cf219f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:55.847828 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2401b94d-9094-433c-a963-c85832cf219f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:55.848585 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2401b94d-9094-433c-a963-c85832cf219f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:55.849022 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2401b94d-9094-433c-a963-c85832cf219f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:55.967862 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-2401b94d-9094-433c-a963-c85832cf219f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:55.975453 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-2401b94d-9094-433c-a963-c85832cf219f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:55.976941 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-2401b94d-9094-433c-a963-c85832cf219f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:55.978085 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2401b94d-9094-433c-a963-c85832cf219f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1745 microversion: 2.20 time: 0.141044 Oct 19 08:33:55.978663 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 680/1366] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:33:55 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1745 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:33:56.466035 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-07b5588d-47ba-4d63-b8c7-16f3a89ecf48 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:56.468048 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-07b5588d-47ba-4d63-b8c7-16f3a89ecf48 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:56.474790 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-07b5588d-47ba-4d63-b8c7-16f3a89ecf48 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:56.475344 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-07b5588d-47ba-4d63-b8c7-16f3a89ecf48 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:56.476127 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-07b5588d-47ba-4d63-b8c7-16f3a89ecf48 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:56.476559 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-07b5588d-47ba-4d63-b8c7-16f3a89ecf48 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:56.547109 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-07b5588d-47ba-4d63-b8c7-16f3a89ecf48 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28619 microversion: 2.1 time: 0.085717 Oct 19 08:33:56.551158 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 687/1367] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:56 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28619 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:56.996249 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-9c22b3f4-4437-4bf3-9433-da370ce68739 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:33:56.996834 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-9c22b3f4-4437-4bf3-9433-da370ce68739 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:57.002772 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9c22b3f4-4437-4bf3-9433-da370ce68739 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:57.003843 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9c22b3f4-4437-4bf3-9433-da370ce68739 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:57.004076 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9c22b3f4-4437-4bf3-9433-da370ce68739 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:57.005190 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9c22b3f4-4437-4bf3-9433-da370ce68739 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:57.128191 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-9c22b3f4-4437-4bf3-9433-da370ce68739 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:57.136320 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-9c22b3f4-4437-4bf3-9433-da370ce68739 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:57.137826 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-9c22b3f4-4437-4bf3-9433-da370ce68739 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:57.139276 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-9c22b3f4-4437-4bf3-9433-da370ce68739 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1745 microversion: 2.20 time: 0.146971 Oct 19 08:33:57.139821 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 681/1368] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:33:56 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1745 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:33:57.560490 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3df53d32-a3c9-4726-8070-2a7c653f5db1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:57.561471 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3df53d32-a3c9-4726-8070-2a7c653f5db1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:57.568030 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3df53d32-a3c9-4726-8070-2a7c653f5db1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:57.568463 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3df53d32-a3c9-4726-8070-2a7c653f5db1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:57.569215 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3df53d32-a3c9-4726-8070-2a7c653f5db1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:57.569636 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3df53d32-a3c9-4726-8070-2a7c653f5db1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:57.647614 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3df53d32-a3c9-4726-8070-2a7c653f5db1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28619 microversion: 2.1 time: 0.092132 Oct 19 08:33:57.648236 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 688/1369] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:57 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28619 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:58.158178 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-6fd07915-2b7d-4984-befb-5dc83af633ee tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:33:58.158814 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-6fd07915-2b7d-4984-befb-5dc83af633ee tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:58.165079 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6fd07915-2b7d-4984-befb-5dc83af633ee tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:58.165526 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6fd07915-2b7d-4984-befb-5dc83af633ee tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:58.166288 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6fd07915-2b7d-4984-befb-5dc83af633ee tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:58.166747 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6fd07915-2b7d-4984-befb-5dc83af633ee tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:58.286201 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-6fd07915-2b7d-4984-befb-5dc83af633ee tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:58.294531 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-6fd07915-2b7d-4984-befb-5dc83af633ee tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:58.296014 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-6fd07915-2b7d-4984-befb-5dc83af633ee tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:58.297154 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-6fd07915-2b7d-4984-befb-5dc83af633ee tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1745 microversion: 2.20 time: 0.142717 Oct 19 08:33:58.297722 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 682/1370] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:33:58 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1745 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:33:58.483107 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-6e8b429b-45da-4f9e-934d-666344a7aac6 req-b93e391f-3a9a-4572-97dc-dfa79f850cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15322fb9-3685-4ce3-9f4d-9a407835f47a", "name": "network-vif-plugged", "status": "completed", "tag": "5a96c138-97d6-476d-b751-ac066e4a3cef"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:58.484578 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:33:58.484578 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:33:58.491940 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-6e8b429b-45da-4f9e-934d-666344a7aac6 req-b93e391f-3a9a-4572-97dc-dfa79f850cc0 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:58.492374 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-6e8b429b-45da-4f9e-934d-666344a7aac6 req-b93e391f-3a9a-4572-97dc-dfa79f850cc0 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:58.503404 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-6e8b429b-45da-4f9e-934d-666344a7aac6 req-b93e391f-3a9a-4572-97dc-dfa79f850cc0 service nova] Creating event network-vif-plugged:5a96c138-97d6-476d-b751-ac066e4a3cef for instance 15322fb9-3685-4ce3-9f4d-9a407835f47a on hv-cinder-81398 Oct 19 08:33:58.508059 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-6e8b429b-45da-4f9e-934d-666344a7aac6 req-b93e391f-3a9a-4572-97dc-dfa79f850cc0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029122 Oct 19 08:33:58.508699 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 689/1371] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:33:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:33:58.659100 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-ad1512c8-58ca-4585-9c34-dc2178ba4893 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:58.660089 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-ad1512c8-58ca-4585-9c34-dc2178ba4893 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:58.665864 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ad1512c8-58ca-4585-9c34-dc2178ba4893 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:58.666312 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ad1512c8-58ca-4585-9c34-dc2178ba4893 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:58.667130 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ad1512c8-58ca-4585-9c34-dc2178ba4893 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:58.667635 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ad1512c8-58ca-4585-9c34-dc2178ba4893 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:58.907269 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-ad1512c8-58ca-4585-9c34-dc2178ba4893 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28619 microversion: 2.1 time: 0.251602 Oct 19 08:33:58.907921 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 683/1372] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:58 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28619 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:33:59.316238 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-040e410c-3c6f-4892-b4d2-528ae13cd53d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:33:59.316910 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-040e410c-3c6f-4892-b4d2-528ae13cd53d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:59.323801 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-040e410c-3c6f-4892-b4d2-528ae13cd53d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:59.324423 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-040e410c-3c6f-4892-b4d2-528ae13cd53d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:59.325529 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-040e410c-3c6f-4892-b4d2-528ae13cd53d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:59.326157 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-040e410c-3c6f-4892-b4d2-528ae13cd53d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:59.459457 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-040e410c-3c6f-4892-b4d2-528ae13cd53d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:59.467978 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-040e410c-3c6f-4892-b4d2-528ae13cd53d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:59.469453 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-040e410c-3c6f-4892-b4d2-528ae13cd53d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:33:59.470840 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-040e410c-3c6f-4892-b4d2-528ae13cd53d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1740 microversion: 2.20 time: 0.158705 Oct 19 08:33:59.471866 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 690/1373] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:33:59 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:33:59.920154 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-75880843-2c3a-41b0-9635-4c8b3e9edade tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:33:59.921143 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-75880843-2c3a-41b0-9635-4c8b3e9edade tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:33:59.927572 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-75880843-2c3a-41b0-9635-4c8b3e9edade tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:59.928023 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-75880843-2c3a-41b0-9635-4c8b3e9edade tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:59.928779 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-75880843-2c3a-41b0-9635-4c8b3e9edade tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:33:59.929210 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-75880843-2c3a-41b0-9635-4c8b3e9edade tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:33:59.992902 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-75880843-2c3a-41b0-9635-4c8b3e9edade tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28619 microversion: 2.1 time: 0.077215 Oct 19 08:33:59.993538 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 684/1374] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:33:59 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28619 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:34:00.490331 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-edd698db-6c2b-4066-bffc-d43bed31b73e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:00.491003 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-edd698db-6c2b-4066-bffc-d43bed31b73e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:00.497826 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-edd698db-6c2b-4066-bffc-d43bed31b73e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:00.498661 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-edd698db-6c2b-4066-bffc-d43bed31b73e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:00.499433 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-edd698db-6c2b-4066-bffc-d43bed31b73e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:00.500130 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-edd698db-6c2b-4066-bffc-d43bed31b73e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:00.627686 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-edd698db-6c2b-4066-bffc-d43bed31b73e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:00.635908 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-edd698db-6c2b-4066-bffc-d43bed31b73e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:00.637418 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-edd698db-6c2b-4066-bffc-d43bed31b73e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:00.639014 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-edd698db-6c2b-4066-bffc-d43bed31b73e tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1740 microversion: 2.20 time: 0.152459 Oct 19 08:34:00.639878 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 691/1375] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:00 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:34:01.005479 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-68a71863-046f-42b5-875a-f53762257270 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:01.006599 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-68a71863-046f-42b5-875a-f53762257270 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:01.013053 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-68a71863-046f-42b5-875a-f53762257270 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:01.013769 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-68a71863-046f-42b5-875a-f53762257270 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:01.014563 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-68a71863-046f-42b5-875a-f53762257270 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:01.015007 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-68a71863-046f-42b5-875a-f53762257270 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:01.079311 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-68a71863-046f-42b5-875a-f53762257270 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28619 microversion: 2.1 time: 0.077672 Oct 19 08:34:01.080026 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 685/1376] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:34:00 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28619 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:34:01.657815 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-56bfd026-50a5-4160-b907-a8fb871bc4d4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:01.658393 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-56bfd026-50a5-4160-b907-a8fb871bc4d4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:01.664257 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-56bfd026-50a5-4160-b907-a8fb871bc4d4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:01.664700 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-56bfd026-50a5-4160-b907-a8fb871bc4d4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:01.665458 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-56bfd026-50a5-4160-b907-a8fb871bc4d4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:01.665881 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-56bfd026-50a5-4160-b907-a8fb871bc4d4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:01.792044 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-56bfd026-50a5-4160-b907-a8fb871bc4d4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:01.800198 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-56bfd026-50a5-4160-b907-a8fb871bc4d4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:01.801674 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-56bfd026-50a5-4160-b907-a8fb871bc4d4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:01.802839 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-56bfd026-50a5-4160-b907-a8fb871bc4d4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1740 microversion: 2.20 time: 0.148790 Oct 19 08:34:01.803389 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 692/1377] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:01 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1740 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:34:02.091441 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-a072da85-50d9-42e2-a642-f75b71b0df27 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:02.092431 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-a072da85-50d9-42e2-a642-f75b71b0df27 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:02.098930 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a072da85-50d9-42e2-a642-f75b71b0df27 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:02.099376 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a072da85-50d9-42e2-a642-f75b71b0df27 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:02.100138 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a072da85-50d9-42e2-a642-f75b71b0df27 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:02.100565 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a072da85-50d9-42e2-a642-f75b71b0df27 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:02.169286 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-a072da85-50d9-42e2-a642-f75b71b0df27 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28619 microversion: 2.1 time: 0.081928 Oct 19 08:34:02.170326 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 686/1378] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:34:02 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28619 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:34:02.824631 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-da19bbd8-9c2c-491c-846a-6f3550f82fd4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:02.825446 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-da19bbd8-9c2c-491c-846a-6f3550f82fd4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:02.832030 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-da19bbd8-9c2c-491c-846a-6f3550f82fd4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:02.832485 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-da19bbd8-9c2c-491c-846a-6f3550f82fd4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:02.833447 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-da19bbd8-9c2c-491c-846a-6f3550f82fd4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:02.834368 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-da19bbd8-9c2c-491c-846a-6f3550f82fd4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:02.972182 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-da19bbd8-9c2c-491c-846a-6f3550f82fd4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:02.980599 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-da19bbd8-9c2c-491c-846a-6f3550f82fd4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:02.982374 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-da19bbd8-9c2c-491c-846a-6f3550f82fd4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:02.983715 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-da19bbd8-9c2c-491c-846a-6f3550f82fd4 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1740 microversion: 2.20 time: 0.162796 Oct 19 08:34:02.984258 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 693/1379] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:02 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:34:03.181923 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d683931a-6a91-48fb-bae1-4b24bf88f267 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:03.183048 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-d683931a-6a91-48fb-bae1-4b24bf88f267 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:03.189959 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d683931a-6a91-48fb-bae1-4b24bf88f267 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:03.190404 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d683931a-6a91-48fb-bae1-4b24bf88f267 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:03.191203 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d683931a-6a91-48fb-bae1-4b24bf88f267 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:03.191633 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d683931a-6a91-48fb-bae1-4b24bf88f267 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:03.257673 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-d683931a-6a91-48fb-bae1-4b24bf88f267 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28619 microversion: 2.1 time: 0.080188 Oct 19 08:34:03.258298 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 687/1380] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:34:03 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28619 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:34:04.001418 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-1c7fa754-f366-44ad-b454-63acfb2e4edc tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:04.002154 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-1c7fa754-f366-44ad-b454-63acfb2e4edc tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:04.008132 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1c7fa754-f366-44ad-b454-63acfb2e4edc tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:04.008806 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1c7fa754-f366-44ad-b454-63acfb2e4edc tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:04.009203 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1c7fa754-f366-44ad-b454-63acfb2e4edc tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:04.009624 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1c7fa754-f366-44ad-b454-63acfb2e4edc tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:04.151593 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-1c7fa754-f366-44ad-b454-63acfb2e4edc tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:04.160008 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-1c7fa754-f366-44ad-b454-63acfb2e4edc tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:04.161495 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-1c7fa754-f366-44ad-b454-63acfb2e4edc tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:04.162681 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-1c7fa754-f366-44ad-b454-63acfb2e4edc tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1740 microversion: 2.20 time: 0.165045 Oct 19 08:34:04.163238 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 694/1381] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:03 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:34:04.269882 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-7012df81-359f-45aa-963c-3e6248cf1f69 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:04.271604 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-7012df81-359f-45aa-963c-3e6248cf1f69 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:04.278961 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7012df81-359f-45aa-963c-3e6248cf1f69 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:04.279692 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7012df81-359f-45aa-963c-3e6248cf1f69 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:04.280698 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7012df81-359f-45aa-963c-3e6248cf1f69 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:04.281334 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7012df81-359f-45aa-963c-3e6248cf1f69 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:04.346902 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-7012df81-359f-45aa-963c-3e6248cf1f69 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28619 microversion: 2.1 time: 0.080770 Oct 19 08:34:04.351177 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 688/1382] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:34:04 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28619 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:34:05.181857 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c4be12f4-91cd-435d-87a8-f2e0ff19c0ab tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:05.182476 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c4be12f4-91cd-435d-87a8-f2e0ff19c0ab tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:05.188567 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c4be12f4-91cd-435d-87a8-f2e0ff19c0ab tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:05.189011 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c4be12f4-91cd-435d-87a8-f2e0ff19c0ab tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:05.189775 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c4be12f4-91cd-435d-87a8-f2e0ff19c0ab tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:05.190198 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c4be12f4-91cd-435d-87a8-f2e0ff19c0ab tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:05.316345 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-c4be12f4-91cd-435d-87a8-f2e0ff19c0ab tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:05.324614 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-c4be12f4-91cd-435d-87a8-f2e0ff19c0ab tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:05.326224 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-c4be12f4-91cd-435d-87a8-f2e0ff19c0ab tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:05.327400 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c4be12f4-91cd-435d-87a8-f2e0ff19c0ab tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1740 microversion: 2.20 time: 0.149396 Oct 19 08:34:05.327950 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 695/1383] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:05 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1740 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:34:05.359390 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-504de115-bc47-48c2-b382-aacec05aab32 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:05.360516 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-504de115-bc47-48c2-b382-aacec05aab32 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:05.367228 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-504de115-bc47-48c2-b382-aacec05aab32 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:05.367831 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-504de115-bc47-48c2-b382-aacec05aab32 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:05.368596 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-504de115-bc47-48c2-b382-aacec05aab32 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:05.369099 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-504de115-bc47-48c2-b382-aacec05aab32 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:05.435855 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-504de115-bc47-48c2-b382-aacec05aab32 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28619 microversion: 2.1 time: 0.080325 Oct 19 08:34:05.437009 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 689/1384] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:34:05 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28619 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:34:06.345733 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-0f68dda4-1297-491b-aafb-d2a86b88d6fe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:06.346503 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-0f68dda4-1297-491b-aafb-d2a86b88d6fe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:06.352511 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0f68dda4-1297-491b-aafb-d2a86b88d6fe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:06.352951 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0f68dda4-1297-491b-aafb-d2a86b88d6fe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:06.353870 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0f68dda4-1297-491b-aafb-d2a86b88d6fe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:06.354323 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0f68dda4-1297-491b-aafb-d2a86b88d6fe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:06.447967 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-fcb86b3f-ab8e-4ab7-8918-9da1f6d50b1b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:06.448992 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-fcb86b3f-ab8e-4ab7-8918-9da1f6d50b1b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:06.469118 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fcb86b3f-ab8e-4ab7-8918-9da1f6d50b1b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:06.469869 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fcb86b3f-ab8e-4ab7-8918-9da1f6d50b1b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:06.470913 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fcb86b3f-ab8e-4ab7-8918-9da1f6d50b1b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:06.471577 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fcb86b3f-ab8e-4ab7-8918-9da1f6d50b1b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:06.507721 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-0f68dda4-1297-491b-aafb-d2a86b88d6fe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:06.515864 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-0f68dda4-1297-491b-aafb-d2a86b88d6fe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:06.517363 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-0f68dda4-1297-491b-aafb-d2a86b88d6fe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:06.518553 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-0f68dda4-1297-491b-aafb-d2a86b88d6fe tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1740 microversion: 2.20 time: 0.176529 Oct 19 08:34:06.523117 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 696/1385] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:06 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:34:06.538974 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-fcb86b3f-ab8e-4ab7-8918-9da1f6d50b1b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28619 microversion: 2.1 time: 0.094871 Oct 19 08:34:06.540440 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 690/1386] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:34:06 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28619 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:34:07.538944 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-d532a1b8-69e7-45c1-8757-c71c297289a6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:07.540503 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-d532a1b8-69e7-45c1-8757-c71c297289a6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:07.547116 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d532a1b8-69e7-45c1-8757-c71c297289a6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:07.547901 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d532a1b8-69e7-45c1-8757-c71c297289a6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:07.548906 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d532a1b8-69e7-45c1-8757-c71c297289a6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:07.549558 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d532a1b8-69e7-45c1-8757-c71c297289a6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:07.551824 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-fb3e7707-c7f4-4e45-a43e-ba3017dda417 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:07.553794 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-fb3e7707-c7f4-4e45-a43e-ba3017dda417 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:07.560912 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fb3e7707-c7f4-4e45-a43e-ba3017dda417 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:07.561705 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fb3e7707-c7f4-4e45-a43e-ba3017dda417 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:07.562882 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fb3e7707-c7f4-4e45-a43e-ba3017dda417 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:07.563764 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fb3e7707-c7f4-4e45-a43e-ba3017dda417 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:07.669271 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-fb3e7707-c7f4-4e45-a43e-ba3017dda417 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28619 microversion: 2.1 time: 0.121063 Oct 19 08:34:07.669836 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 691/1387] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:34:07 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28619 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:34:07.734670 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-d532a1b8-69e7-45c1-8757-c71c297289a6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:07.742595 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-d532a1b8-69e7-45c1-8757-c71c297289a6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:07.744083 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-d532a1b8-69e7-45c1-8757-c71c297289a6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:07.745477 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-d532a1b8-69e7-45c1-8757-c71c297289a6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1740 microversion: 2.20 time: 0.210235 Oct 19 08:34:07.746532 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 697/1388] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:07 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:34:08.681811 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-ce0dddbc-bd09-4506-a935-23f7ce66dd37 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:08.684069 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-ce0dddbc-bd09-4506-a935-23f7ce66dd37 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:08.691025 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ce0dddbc-bd09-4506-a935-23f7ce66dd37 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:08.691547 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ce0dddbc-bd09-4506-a935-23f7ce66dd37 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:08.692389 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ce0dddbc-bd09-4506-a935-23f7ce66dd37 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:08.692892 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ce0dddbc-bd09-4506-a935-23f7ce66dd37 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:08.763391 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-ce0dddbc-bd09-4506-a935-23f7ce66dd37 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 28619 microversion: 2.1 time: 0.085591 Oct 19 08:34:08.764958 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 692/1389] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:34:08 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 28619 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:34:08.768253 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-731874cf-89bd-4933-9af0-127d1cfe4733 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:08.768965 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-731874cf-89bd-4933-9af0-127d1cfe4733 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:08.775164 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-731874cf-89bd-4933-9af0-127d1cfe4733 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:08.775992 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-731874cf-89bd-4933-9af0-127d1cfe4733 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:08.776979 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-731874cf-89bd-4933-9af0-127d1cfe4733 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:08.778146 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-731874cf-89bd-4933-9af0-127d1cfe4733 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:08.920641 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-731874cf-89bd-4933-9af0-127d1cfe4733 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:08.929014 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-731874cf-89bd-4933-9af0-127d1cfe4733 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:08.930848 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-731874cf-89bd-4933-9af0-127d1cfe4733 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:08.932459 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-731874cf-89bd-4933-9af0-127d1cfe4733 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1740 microversion: 2.20 time: 0.172273 Oct 19 08:34:08.933046 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 698/1390] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:08 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:34:09.776140 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-cb6de737-57f5-40d8-bbf5-1195c4a5a585 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:09.777037 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-cb6de737-57f5-40d8-bbf5-1195c4a5a585 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:09.784512 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cb6de737-57f5-40d8-bbf5-1195c4a5a585 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:09.785176 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cb6de737-57f5-40d8-bbf5-1195c4a5a585 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:09.786188 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cb6de737-57f5-40d8-bbf5-1195c4a5a585 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:09.786852 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-cb6de737-57f5-40d8-bbf5-1195c4a5a585 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:09.871770 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-cb6de737-57f5-40d8-bbf5-1195c4a5a585 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 29866 microversion: 2.1 time: 0.099390 Oct 19 08:34:09.872533 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 693/1391] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:34:09 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 29866 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:34:09.951956 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-fce7b68c-8655-4517-ad2f-a6302d73ff7b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:09.952693 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-fce7b68c-8655-4517-ad2f-a6302d73ff7b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:09.959916 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fce7b68c-8655-4517-ad2f-a6302d73ff7b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:09.961029 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fce7b68c-8655-4517-ad2f-a6302d73ff7b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:09.962366 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fce7b68c-8655-4517-ad2f-a6302d73ff7b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:09.962952 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fce7b68c-8655-4517-ad2f-a6302d73ff7b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:10.090427 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-fce7b68c-8655-4517-ad2f-a6302d73ff7b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:10.107116 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-fce7b68c-8655-4517-ad2f-a6302d73ff7b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:10.108582 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-fce7b68c-8655-4517-ad2f-a6302d73ff7b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:10.109847 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-fce7b68c-8655-4517-ad2f-a6302d73ff7b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1740 microversion: 2.20 time: 0.162100 Oct 19 08:34:10.110465 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 699/1392] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:09 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:34:10.883137 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-92770c22-4962-4827-86b3-833e2a80256d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:10.884117 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-92770c22-4962-4827-86b3-833e2a80256d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:10.891437 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-92770c22-4962-4827-86b3-833e2a80256d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:10.891931 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-92770c22-4962-4827-86b3-833e2a80256d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:10.892681 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-92770c22-4962-4827-86b3-833e2a80256d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:10.893102 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-92770c22-4962-4827-86b3-833e2a80256d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:10.989492 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-92770c22-4962-4827-86b3-833e2a80256d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 31604 microversion: 2.1 time: 0.110250 Oct 19 08:34:10.990123 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 694/1393] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:34:10 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 31604 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:34:11.128110 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-7c0b8533-ff83-4d4f-9714-462575f53267 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:11.128713 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-7c0b8533-ff83-4d4f-9714-462575f53267 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:11.134639 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7c0b8533-ff83-4d4f-9714-462575f53267 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:11.135023 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7c0b8533-ff83-4d4f-9714-462575f53267 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:11.135808 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7c0b8533-ff83-4d4f-9714-462575f53267 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:11.136255 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7c0b8533-ff83-4d4f-9714-462575f53267 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:11.342885 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-7c0b8533-ff83-4d4f-9714-462575f53267 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:11.350612 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-7c0b8533-ff83-4d4f-9714-462575f53267 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:11.352109 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-7c0b8533-ff83-4d4f-9714-462575f53267 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:11.353271 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-7c0b8533-ff83-4d4f-9714-462575f53267 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1722 microversion: 2.20 time: 0.228949 Oct 19 08:34:11.353854 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 700/1394] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:11 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:34:12.001998 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-fa9aee25-7c54-4caa-b874-69a8882e5cd1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:12.003026 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-fa9aee25-7c54-4caa-b874-69a8882e5cd1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:12.009456 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fa9aee25-7c54-4caa-b874-69a8882e5cd1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:12.009900 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fa9aee25-7c54-4caa-b874-69a8882e5cd1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:12.010688 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fa9aee25-7c54-4caa-b874-69a8882e5cd1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:12.011117 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-fa9aee25-7c54-4caa-b874-69a8882e5cd1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:12.097058 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-fa9aee25-7c54-4caa-b874-69a8882e5cd1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 33068 microversion: 2.1 time: 0.098952 Oct 19 08:34:12.097941 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 695/1395] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:34:11 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 33068 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:34:12.372644 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-95833bdc-6dcf-4043-9661-48894d1d6dc8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:12.373279 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-95833bdc-6dcf-4043-9661-48894d1d6dc8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:12.379351 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-95833bdc-6dcf-4043-9661-48894d1d6dc8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:12.379788 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-95833bdc-6dcf-4043-9661-48894d1d6dc8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:12.380544 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-95833bdc-6dcf-4043-9661-48894d1d6dc8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:12.380965 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-95833bdc-6dcf-4043-9661-48894d1d6dc8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:12.501780 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-95833bdc-6dcf-4043-9661-48894d1d6dc8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:12.509418 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-95833bdc-6dcf-4043-9661-48894d1d6dc8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:12.510926 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-95833bdc-6dcf-4043-9661-48894d1d6dc8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:12.512850 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-95833bdc-6dcf-4043-9661-48894d1d6dc8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1722 microversion: 2.20 time: 0.144346 Oct 19 08:34:12.513401 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 701/1396] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:12 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1722 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:34:13.110279 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-56b6efc1-d5b3-4285-afe0-c09cc34ff95a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:13.111320 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-56b6efc1-d5b3-4285-afe0-c09cc34ff95a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:13.117707 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-56b6efc1-d5b3-4285-afe0-c09cc34ff95a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:13.118148 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-56b6efc1-d5b3-4285-afe0-c09cc34ff95a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:13.118932 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-56b6efc1-d5b3-4285-afe0-c09cc34ff95a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:13.119358 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-56b6efc1-d5b3-4285-afe0-c09cc34ff95a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:13.192806 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-56b6efc1-d5b3-4285-afe0-c09cc34ff95a tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 33651 microversion: 2.1 time: 0.087223 Oct 19 08:34:13.193688 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 696/1397] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:34:13 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 33651 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:34:13.530963 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-5abfeeb3-6ddc-400c-b2e5-3985b7d94f54 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:13.531601 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-5abfeeb3-6ddc-400c-b2e5-3985b7d94f54 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:13.538050 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5abfeeb3-6ddc-400c-b2e5-3985b7d94f54 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:13.538505 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5abfeeb3-6ddc-400c-b2e5-3985b7d94f54 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:13.539265 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5abfeeb3-6ddc-400c-b2e5-3985b7d94f54 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:13.539687 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5abfeeb3-6ddc-400c-b2e5-3985b7d94f54 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:13.660868 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-5abfeeb3-6ddc-400c-b2e5-3985b7d94f54 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:13.668737 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-5abfeeb3-6ddc-400c-b2e5-3985b7d94f54 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:13.670235 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-5abfeeb3-6ddc-400c-b2e5-3985b7d94f54 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:13.671414 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-5abfeeb3-6ddc-400c-b2e5-3985b7d94f54 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1722 microversion: 2.20 time: 0.144166 Oct 19 08:34:13.671960 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 702/1398] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:13 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1722 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:34:14.205651 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-03e15be5-1dd8-4f2e-920e-0effab11c9d1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:14.206707 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-03e15be5-1dd8-4f2e-920e-0effab11c9d1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:14.213093 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-03e15be5-1dd8-4f2e-920e-0effab11c9d1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:14.213596 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-03e15be5-1dd8-4f2e-920e-0effab11c9d1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:14.214386 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-03e15be5-1dd8-4f2e-920e-0effab11c9d1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:14.215671 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-03e15be5-1dd8-4f2e-920e-0effab11c9d1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:14.291348 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-03e15be5-1dd8-4f2e-920e-0effab11c9d1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 34794 microversion: 2.1 time: 0.089565 Oct 19 08:34:14.291893 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 697/1399] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:34:14 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 34794 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:34:14.517235 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-68ec72ad-28e2-487c-b27b-39a2940b34fa req-bb73a2fe-200e-4b6b-ad30-ec346207b743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15322fb9-3685-4ce3-9f4d-9a407835f47a", "name": "network-vif-unplugged", "status": "completed", "tag": "5a96c138-97d6-476d-b751-ac066e4a3cef"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:14.518767 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:34:14.518767 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:34:14.526320 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-68ec72ad-28e2-487c-b27b-39a2940b34fa req-bb73a2fe-200e-4b6b-ad30-ec346207b743 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:14.526774 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-68ec72ad-28e2-487c-b27b-39a2940b34fa req-bb73a2fe-200e-4b6b-ad30-ec346207b743 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:14.538224 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.compute.server_external_events [req-68ec72ad-28e2-487c-b27b-39a2940b34fa req-bb73a2fe-200e-4b6b-ad30-ec346207b743 service nova] Unable to find a host for instance 15322fb9-3685-4ce3-9f4d-9a407835f47a. Dropping event network-vif-unplugged {{(pid=114106) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Oct 19 08:34:14.539111 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-68ec72ad-28e2-487c-b27b-39a2940b34fa req-bb73a2fe-200e-4b6b-ad30-ec346207b743 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025959 Oct 19 08:34:14.539672 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 703/1400] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:34:14 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 19 08:34:14.689543 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-045b0e66-5f48-4933-b9f1-783198eefec2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:14.690233 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-045b0e66-5f48-4933-b9f1-783198eefec2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:14.696678 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-045b0e66-5f48-4933-b9f1-783198eefec2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:14.697132 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-045b0e66-5f48-4933-b9f1-783198eefec2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:14.697894 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-045b0e66-5f48-4933-b9f1-783198eefec2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:14.698328 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-045b0e66-5f48-4933-b9f1-783198eefec2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:14.868346 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-045b0e66-5f48-4933-b9f1-783198eefec2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:14.875966 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-045b0e66-5f48-4933-b9f1-783198eefec2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:14.877434 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-045b0e66-5f48-4933-b9f1-783198eefec2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:14.878595 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-045b0e66-5f48-4933-b9f1-783198eefec2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1665 microversion: 2.20 time: 0.193127 Oct 19 08:34:14.879144 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 698/1401] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:14 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1665 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:34:14.896753 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b0a1ddd4-20d4-4020-b84f-c78347f632c6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af5b7c09-4b1d-49c2-846a-db9e61f2a335"}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:14.897780 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b0a1ddd4-20d4-4020-b84f-c78347f632c6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:14.904108 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b0a1ddd4-20d4-4020-b84f-c78347f632c6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:14.904736 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b0a1ddd4-20d4-4020-b84f-c78347f632c6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:14.905838 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b0a1ddd4-20d4-4020-b84f-c78347f632c6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:14.906417 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b0a1ddd4-20d4-4020-b84f-c78347f632c6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:15.156637 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b0a1ddd4-20d4-4020-b84f-c78347f632c6 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.263532 Oct 19 08:34:15.157230 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 704/1402] 10.222.0.26 () {62 vars in 1363 bytes} [Tue Oct 19 08:34:14 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/os-volume_attachments => generated 188 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:34:15.264515 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-9292a9b9-4a6c-4d97-9ee1-c01437252d93 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:15.265138 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-9292a9b9-4a6c-4d97-9ee1-c01437252d93 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:15.270771 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9292a9b9-4a6c-4d97-9ee1-c01437252d93 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:15.271222 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9292a9b9-4a6c-4d97-9ee1-c01437252d93 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:15.271989 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9292a9b9-4a6c-4d97-9ee1-c01437252d93 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:15.272428 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9292a9b9-4a6c-4d97-9ee1-c01437252d93 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:15.303773 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-fc591d34-7a33-4a3a-96ba-26332052b515 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:15.306063 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-fc591d34-7a33-4a3a-96ba-26332052b515 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:15.312109 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fc591d34-7a33-4a3a-96ba-26332052b515 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:15.312555 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fc591d34-7a33-4a3a-96ba-26332052b515 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:15.313324 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fc591d34-7a33-4a3a-96ba-26332052b515 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:15.313753 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-fc591d34-7a33-4a3a-96ba-26332052b515 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:15.395031 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-fc591d34-7a33-4a3a-96ba-26332052b515 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 35689 microversion: 2.1 time: 0.094682 Oct 19 08:34:15.395678 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 705/1403] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:34:15 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 35689 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:34:15.514868 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-9292a9b9-4a6c-4d97-9ee1-c01437252d93 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "DELETE /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/os-volume_attachments/af5b7c09-4b1d-49c2-846a-db9e61f2a335" status: 202 len: 0 microversion: 2.20 time: 0.254314 Oct 19 08:34:15.515451 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 699/1404] 10.222.0.26 () {60 vars in 1456 bytes} [Tue Oct 19 08:34:15 2021] DELETE /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/os-volume_attachments/af5b7c09-4b1d-49c2-846a-db9e61f2a335 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 08:34:15.639085 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-71320951-3765-43bd-b301-282cb61ebf11 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:15.639678 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-71320951-3765-43bd-b301-282cb61ebf11 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:15.645614 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-71320951-3765-43bd-b301-282cb61ebf11 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:15.646060 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-71320951-3765-43bd-b301-282cb61ebf11 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:15.646863 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-71320951-3765-43bd-b301-282cb61ebf11 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:15.647295 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-71320951-3765-43bd-b301-282cb61ebf11 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:15.735523 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-71320951-3765-43bd-b301-282cb61ebf11 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action" status: 202 len: 0 microversion: 2.20 time: 0.171178 Oct 19 08:34:15.736128 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 706/1405] 10.222.0.26 () {62 vars in 1318 bytes} [Tue Oct 19 08:34:15 2021] POST /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 08:34:15.744043 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-0d148863-3665-450e-9fa4-3a773ac40f99 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:15.744645 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-0d148863-3665-450e-9fa4-3a773ac40f99 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:15.752018 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0d148863-3665-450e-9fa4-3a773ac40f99 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:15.752464 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0d148863-3665-450e-9fa4-3a773ac40f99 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:15.753263 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0d148863-3665-450e-9fa4-3a773ac40f99 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:15.753661 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0d148863-3665-450e-9fa4-3a773ac40f99 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:15.876440 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-0d148863-3665-450e-9fa4-3a773ac40f99 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:15.884031 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-0d148863-3665-450e-9fa4-3a773ac40f99 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:15.885515 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-0d148863-3665-450e-9fa4-3a773ac40f99 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:15.886745 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-0d148863-3665-450e-9fa4-3a773ac40f99 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1673 microversion: 2.20 time: 0.146356 Oct 19 08:34:15.887294 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 700/1406] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:15 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:34:15.950520 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 08:34:15.950673 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: Tue Oct 19 08:34:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 19 08:34:16.407058 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-77db80e0-c501-4fcc-b2dc-ca05940f62a8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:16.407975 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-77db80e0-c501-4fcc-b2dc-ca05940f62a8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:16.413781 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-77db80e0-c501-4fcc-b2dc-ca05940f62a8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:16.414229 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-77db80e0-c501-4fcc-b2dc-ca05940f62a8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:16.415023 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-77db80e0-c501-4fcc-b2dc-ca05940f62a8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:16.415457 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-77db80e0-c501-4fcc-b2dc-ca05940f62a8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:16.492033 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-77db80e0-c501-4fcc-b2dc-ca05940f62a8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 37307 microversion: 2.1 time: 0.088610 Oct 19 08:34:16.492579 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 707/1407] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:34:16 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 37307 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:34:16.905014 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-131ddc60-b6d2-4c74-8e5b-8e0a7eab1b0a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:16.905595 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-131ddc60-b6d2-4c74-8e5b-8e0a7eab1b0a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:16.911374 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-131ddc60-b6d2-4c74-8e5b-8e0a7eab1b0a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:16.911817 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-131ddc60-b6d2-4c74-8e5b-8e0a7eab1b0a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:16.912568 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-131ddc60-b6d2-4c74-8e5b-8e0a7eab1b0a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:16.912994 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-131ddc60-b6d2-4c74-8e5b-8e0a7eab1b0a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:17.108778 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-131ddc60-b6d2-4c74-8e5b-8e0a7eab1b0a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:17.116324 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-131ddc60-b6d2-4c74-8e5b-8e0a7eab1b0a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:17.117813 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-131ddc60-b6d2-4c74-8e5b-8e0a7eab1b0a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:17.118990 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-131ddc60-b6d2-4c74-8e5b-8e0a7eab1b0a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1731 microversion: 2.20 time: 0.218402 Oct 19 08:34:17.119542 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 701/1408] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:16 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1731 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:34:17.203758 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ed6a6d41-c276-4280-88b6-8a50c26aedbd tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:17.204359 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ed6a6d41-c276-4280-88b6-8a50c26aedbd tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:17.210828 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ed6a6d41-c276-4280-88b6-8a50c26aedbd tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:17.211278 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ed6a6d41-c276-4280-88b6-8a50c26aedbd tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:17.212041 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ed6a6d41-c276-4280-88b6-8a50c26aedbd tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:17.212468 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ed6a6d41-c276-4280-88b6-8a50c26aedbd tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:17.236101 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.objects.instance [None req-ed6a6d41-c276-4280-88b6-8a50c26aedbd tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lazy-loading 'flavor' on Instance uuid 59c3fb17-9b00-4111-afa2-59ce69f7a986 {{(pid=114106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 19 08:34:17.307009 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ed6a6d41-c276-4280-88b6-8a50c26aedbd tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "POST /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986/action" status: 202 len: 0 microversion: 2.1 time: 0.108270 Oct 19 08:34:17.307784 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 708/1409] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:34:17 2021] POST /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:34:17.315888 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2e5b6d22-12c5-4faa-9afe-21dcf3532dee tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:17.316482 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2e5b6d22-12c5-4faa-9afe-21dcf3532dee tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:17.322183 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2e5b6d22-12c5-4faa-9afe-21dcf3532dee tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:17.322658 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2e5b6d22-12c5-4faa-9afe-21dcf3532dee tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:17.323418 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2e5b6d22-12c5-4faa-9afe-21dcf3532dee tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:17.323836 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2e5b6d22-12c5-4faa-9afe-21dcf3532dee tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:17.504849 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-bf71ab67-f593-4cde-9ac3-f5a90a586694 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:17.505982 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-bf71ab67-f593-4cde-9ac3-f5a90a586694 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:17.513437 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bf71ab67-f593-4cde-9ac3-f5a90a586694 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:17.514151 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bf71ab67-f593-4cde-9ac3-f5a90a586694 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:17.515201 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bf71ab67-f593-4cde-9ac3-f5a90a586694 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:17.515633 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bf71ab67-f593-4cde-9ac3-f5a90a586694 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:17.614166 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-bf71ab67-f593-4cde-9ac3-f5a90a586694 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 38147 microversion: 2.1 time: 0.112331 Oct 19 08:34:17.623722 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 709/1410] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:34:17 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 38147 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 08:34:17.751094 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-2e5b6d22-12c5-4faa-9afe-21dcf3532dee tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:17.764287 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2e5b6d22-12c5-4faa-9afe-21dcf3532dee tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1569 microversion: 2.1 time: 0.451748 Oct 19 08:34:17.765298 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 702/1411] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:17 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1569 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:18.138127 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c84b7bb8-ae82-4f0e-9448-57efeac87972 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:18.139082 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c84b7bb8-ae82-4f0e-9448-57efeac87972 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:18.145536 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c84b7bb8-ae82-4f0e-9448-57efeac87972 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:18.145978 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c84b7bb8-ae82-4f0e-9448-57efeac87972 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:18.146787 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c84b7bb8-ae82-4f0e-9448-57efeac87972 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:18.147229 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c84b7bb8-ae82-4f0e-9448-57efeac87972 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:18.227193 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-0a1775ce-0a56-4dfa-b28c-3eb440905cba tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:18.227803 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-0a1775ce-0a56-4dfa-b28c-3eb440905cba tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:18.234044 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0a1775ce-0a56-4dfa-b28c-3eb440905cba tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:18.234485 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0a1775ce-0a56-4dfa-b28c-3eb440905cba tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:18.235273 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0a1775ce-0a56-4dfa-b28c-3eb440905cba tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:18.235807 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0a1775ce-0a56-4dfa-b28c-3eb440905cba tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:18.264426 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-0a1775ce-0a56-4dfa-b28c-3eb440905cba tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Going to try to terminate instance {{(pid=114105) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 19 08:34:18.282607 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-c84b7bb8-ae82-4f0e-9448-57efeac87972 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:18.291343 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-c84b7bb8-ae82-4f0e-9448-57efeac87972 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:18.293465 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-c84b7bb8-ae82-4f0e-9448-57efeac87972 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:18.294759 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c84b7bb8-ae82-4f0e-9448-57efeac87972 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1731 microversion: 2.20 time: 0.160889 Oct 19 08:34:18.295321 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 710/1412] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:18 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:34:18.341665 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-0a1775ce-0a56-4dfa-b28c-3eb440905cba tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 204 len: 0 microversion: 2.1 time: 0.117798 Oct 19 08:34:18.342258 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 703/1413] 10.222.0.26 () {58 vars in 1238 bytes} [Tue Oct 19 08:34:18 2021] DELETE /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 08:34:18.350260 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-4f80491c-84cf-4876-a1c5-72c9e30a2e3b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:18.351055 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-4f80491c-84cf-4876-a1c5-72c9e30a2e3b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:18.357980 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4f80491c-84cf-4876-a1c5-72c9e30a2e3b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:18.358664 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4f80491c-84cf-4876-a1c5-72c9e30a2e3b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:18.359733 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4f80491c-84cf-4876-a1c5-72c9e30a2e3b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:18.360387 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4f80491c-84cf-4876-a1c5-72c9e30a2e3b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:18.493388 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-4f80491c-84cf-4876-a1c5-72c9e30a2e3b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:18.500814 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-4f80491c-84cf-4876-a1c5-72c9e30a2e3b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1578 microversion: 2.1 time: 0.154410 Oct 19 08:34:18.501385 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 711/1414] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:18 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:18.626981 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c49ecef6-f1da-4502-a6ab-f4b97b8f6129 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:18.628015 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-c49ecef6-f1da-4502-a6ab-f4b97b8f6129 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:18.633718 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c49ecef6-f1da-4502-a6ab-f4b97b8f6129 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:18.634160 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c49ecef6-f1da-4502-a6ab-f4b97b8f6129 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:18.634935 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c49ecef6-f1da-4502-a6ab-f4b97b8f6129 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:18.635355 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c49ecef6-f1da-4502-a6ab-f4b97b8f6129 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:18.783347 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b488fb4e-226b-4f32-bac9-b97bb8c12dc6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:18.784046 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b488fb4e-226b-4f32-bac9-b97bb8c12dc6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:18.793917 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b488fb4e-226b-4f32-bac9-b97bb8c12dc6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:18.794454 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b488fb4e-226b-4f32-bac9-b97bb8c12dc6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:18.795325 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b488fb4e-226b-4f32-bac9-b97bb8c12dc6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:18.795825 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b488fb4e-226b-4f32-bac9-b97bb8c12dc6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:18.917626 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-b488fb4e-226b-4f32-bac9-b97bb8c12dc6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:18.924974 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b488fb4e-226b-4f32-bac9-b97bb8c12dc6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1569 microversion: 2.1 time: 0.145398 Oct 19 08:34:18.925521 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 712/1415] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:18 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1569 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:19.315126 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-16d99a59-3f81-4472-a4e0-65cd5708216d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:19.315822 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-16d99a59-3f81-4472-a4e0-65cd5708216d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:19.322073 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-16d99a59-3f81-4472-a4e0-65cd5708216d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:19.322533 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-16d99a59-3f81-4472-a4e0-65cd5708216d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:19.323301 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-16d99a59-3f81-4472-a4e0-65cd5708216d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:19.323723 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-16d99a59-3f81-4472-a4e0-65cd5708216d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:19.462400 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-16d99a59-3f81-4472-a4e0-65cd5708216d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:19.470280 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-16d99a59-3f81-4472-a4e0-65cd5708216d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:19.471806 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-16d99a59-3f81-4472-a4e0-65cd5708216d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:19.472955 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-16d99a59-3f81-4472-a4e0-65cd5708216d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1731 microversion: 2.20 time: 0.161572 Oct 19 08:34:19.473507 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 713/1416] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:19 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:34:19.518749 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-2e818bd4-ae47-4825-803c-d2b9bac04f75 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:19.519504 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-2e818bd4-ae47-4825-803c-d2b9bac04f75 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:19.525358 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2e818bd4-ae47-4825-803c-d2b9bac04f75 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:19.525804 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2e818bd4-ae47-4825-803c-d2b9bac04f75 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:19.526585 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2e818bd4-ae47-4825-803c-d2b9bac04f75 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:19.527013 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2e818bd4-ae47-4825-803c-d2b9bac04f75 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:19.655681 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-2e818bd4-ae47-4825-803c-d2b9bac04f75 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:19.662921 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-2e818bd4-ae47-4825-803c-d2b9bac04f75 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1578 microversion: 2.1 time: 0.147995 Oct 19 08:34:19.663477 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 714/1417] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:19 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1578 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:19.940987 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-8140b745-4913-43bf-8d32-7d169db56b08 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:19.941500 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-8140b745-4913-43bf-8d32-7d169db56b08 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:19.947305 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8140b745-4913-43bf-8d32-7d169db56b08 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:19.947740 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8140b745-4913-43bf-8d32-7d169db56b08 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:19.948487 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8140b745-4913-43bf-8d32-7d169db56b08 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:19.948913 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8140b745-4913-43bf-8d32-7d169db56b08 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:20.072343 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-8140b745-4913-43bf-8d32-7d169db56b08 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:20.080709 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-8140b745-4913-43bf-8d32-7d169db56b08 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1569 microversion: 2.1 time: 0.143395 Oct 19 08:34:20.081548 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 715/1418] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:19 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1569 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:34:20.491495 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-1c1b645c-3dbb-4ce0-b0f4-5e245d67d79a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:20.492292 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-1c1b645c-3dbb-4ce0-b0f4-5e245d67d79a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:20.499276 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1c1b645c-3dbb-4ce0-b0f4-5e245d67d79a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:20.499729 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1c1b645c-3dbb-4ce0-b0f4-5e245d67d79a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:20.500503 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1c1b645c-3dbb-4ce0-b0f4-5e245d67d79a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:20.500937 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1c1b645c-3dbb-4ce0-b0f4-5e245d67d79a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:20.631536 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-1c1b645c-3dbb-4ce0-b0f4-5e245d67d79a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:20.661858 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-1c1b645c-3dbb-4ce0-b0f4-5e245d67d79a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:20.663284 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-1c1b645c-3dbb-4ce0-b0f4-5e245d67d79a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:20.664502 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-1c1b645c-3dbb-4ce0-b0f4-5e245d67d79a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1731 microversion: 2.20 time: 0.176860 Oct 19 08:34:20.665277 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 716/1419] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:20 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:34:20.680199 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ce64e986-afba-4c2e-a1b2-a8b0c4550d63 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:20.680797 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ce64e986-afba-4c2e-a1b2-a8b0c4550d63 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:20.687461 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ce64e986-afba-4c2e-a1b2-a8b0c4550d63 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:20.687909 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ce64e986-afba-4c2e-a1b2-a8b0c4550d63 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:20.688669 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ce64e986-afba-4c2e-a1b2-a8b0c4550d63 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:20.689098 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ce64e986-afba-4c2e-a1b2-a8b0c4550d63 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:20.816270 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ce64e986-afba-4c2e-a1b2-a8b0c4550d63 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:20.823768 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ce64e986-afba-4c2e-a1b2-a8b0c4550d63 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1578 microversion: 2.1 time: 0.147149 Oct 19 08:34:20.834632 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 717/1420] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:20 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:34:21.098204 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-dad06911-2df3-40ee-b257-409c74d0c425 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:21.099044 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-dad06911-2df3-40ee-b257-409c74d0c425 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:21.105016 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-dad06911-2df3-40ee-b257-409c74d0c425 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:21.106074 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-dad06911-2df3-40ee-b257-409c74d0c425 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:21.107030 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-dad06911-2df3-40ee-b257-409c74d0c425 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:21.107485 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-dad06911-2df3-40ee-b257-409c74d0c425 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:21.229386 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-dad06911-2df3-40ee-b257-409c74d0c425 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:21.237521 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-dad06911-2df3-40ee-b257-409c74d0c425 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1569 microversion: 2.1 time: 0.142987 Oct 19 08:34:21.238106 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 718/1421] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:21 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1569 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:34:21.682583 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-de10f8b0-f32d-41d3-a0ee-519b01aabce5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:21.683359 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-de10f8b0-f32d-41d3-a0ee-519b01aabce5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:21.689443 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-de10f8b0-f32d-41d3-a0ee-519b01aabce5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:21.690028 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-de10f8b0-f32d-41d3-a0ee-519b01aabce5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:21.690924 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-de10f8b0-f32d-41d3-a0ee-519b01aabce5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:21.691369 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-de10f8b0-f32d-41d3-a0ee-519b01aabce5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:21.814458 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-de10f8b0-f32d-41d3-a0ee-519b01aabce5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:21.823080 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-de10f8b0-f32d-41d3-a0ee-519b01aabce5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:21.825093 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-de10f8b0-f32d-41d3-a0ee-519b01aabce5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:21.826272 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-de10f8b0-f32d-41d3-a0ee-519b01aabce5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1731 microversion: 2.20 time: 0.147529 Oct 19 08:34:21.826980 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 719/1422] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:21 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:34:21.841664 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-17a0f3f3-c11b-4a43-9c8c-4e7395674992 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:21.842263 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-17a0f3f3-c11b-4a43-9c8c-4e7395674992 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:21.848088 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-17a0f3f3-c11b-4a43-9c8c-4e7395674992 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:21.848525 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-17a0f3f3-c11b-4a43-9c8c-4e7395674992 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:21.849274 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-17a0f3f3-c11b-4a43-9c8c-4e7395674992 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:21.849699 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-17a0f3f3-c11b-4a43-9c8c-4e7395674992 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:21.973663 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-17a0f3f3-c11b-4a43-9c8c-4e7395674992 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:21.982061 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-17a0f3f3-c11b-4a43-9c8c-4e7395674992 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1578 microversion: 2.1 time: 0.144580 Oct 19 08:34:21.982905 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 720/1423] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:21 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1578 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:34:22.254737 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-843743c8-0153-4fd7-bac7-1a8cb522fa84 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:22.255263 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-843743c8-0153-4fd7-bac7-1a8cb522fa84 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:22.261083 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-843743c8-0153-4fd7-bac7-1a8cb522fa84 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:22.262188 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-843743c8-0153-4fd7-bac7-1a8cb522fa84 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:22.263088 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-843743c8-0153-4fd7-bac7-1a8cb522fa84 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:22.263527 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-843743c8-0153-4fd7-bac7-1a8cb522fa84 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:22.393430 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-843743c8-0153-4fd7-bac7-1a8cb522fa84 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:22.403233 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-843743c8-0153-4fd7-bac7-1a8cb522fa84 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1569 microversion: 2.1 time: 0.151813 Oct 19 08:34:22.405437 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 721/1424] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:22 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:34:22.845285 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3123344e-2aad-4ebf-a710-a3efec371a86 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:22.845941 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3123344e-2aad-4ebf-a710-a3efec371a86 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:22.851742 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3123344e-2aad-4ebf-a710-a3efec371a86 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:22.852190 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3123344e-2aad-4ebf-a710-a3efec371a86 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:22.852948 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3123344e-2aad-4ebf-a710-a3efec371a86 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:22.853378 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3123344e-2aad-4ebf-a710-a3efec371a86 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:22.975505 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3123344e-2aad-4ebf-a710-a3efec371a86 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:22.983348 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3123344e-2aad-4ebf-a710-a3efec371a86 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:22.984825 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3123344e-2aad-4ebf-a710-a3efec371a86 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:22.985969 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3123344e-2aad-4ebf-a710-a3efec371a86 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1731 microversion: 2.20 time: 0.144627 Oct 19 08:34:22.986531 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 722/1425] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:22 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1731 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:34:22.999954 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-69c48c0c-8f52-4f74-8885-1b38d1770a18 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:23.001915 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-69c48c0c-8f52-4f74-8885-1b38d1770a18 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:23.008335 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-69c48c0c-8f52-4f74-8885-1b38d1770a18 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:23.008779 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-69c48c0c-8f52-4f74-8885-1b38d1770a18 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:23.009709 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-69c48c0c-8f52-4f74-8885-1b38d1770a18 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:23.010141 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-69c48c0c-8f52-4f74-8885-1b38d1770a18 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:23.138648 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-69c48c0c-8f52-4f74-8885-1b38d1770a18 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:23.146380 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-69c48c0c-8f52-4f74-8885-1b38d1770a18 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1578 microversion: 2.1 time: 0.150881 Oct 19 08:34:23.146972 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 723/1426] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:22 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1578 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:34:23.421503 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-9ce404d2-edab-43b4-9011-91ee3927f534 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:23.422101 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-9ce404d2-edab-43b4-9011-91ee3927f534 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:23.427947 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9ce404d2-edab-43b4-9011-91ee3927f534 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:23.428384 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9ce404d2-edab-43b4-9011-91ee3927f534 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:23.429124 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9ce404d2-edab-43b4-9011-91ee3927f534 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:23.429545 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9ce404d2-edab-43b4-9011-91ee3927f534 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:23.562071 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-9ce404d2-edab-43b4-9011-91ee3927f534 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:23.569448 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-9ce404d2-edab-43b4-9011-91ee3927f534 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1569 microversion: 2.1 time: 0.152488 Oct 19 08:34:23.569999 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 724/1427] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:23 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:34:24.005561 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-14b51690-9bfc-49e1-a608-2dfc3878e313 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:24.006276 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-14b51690-9bfc-49e1-a608-2dfc3878e313 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:24.012597 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-14b51690-9bfc-49e1-a608-2dfc3878e313 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:24.013039 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-14b51690-9bfc-49e1-a608-2dfc3878e313 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:24.014058 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-14b51690-9bfc-49e1-a608-2dfc3878e313 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:24.014515 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-14b51690-9bfc-49e1-a608-2dfc3878e313 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:24.140344 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-14b51690-9bfc-49e1-a608-2dfc3878e313 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:24.148065 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-14b51690-9bfc-49e1-a608-2dfc3878e313 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:24.149539 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-14b51690-9bfc-49e1-a608-2dfc3878e313 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:24.150710 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-14b51690-9bfc-49e1-a608-2dfc3878e313 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1731 microversion: 2.20 time: 0.148954 Oct 19 08:34:24.151262 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 725/1428] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:24 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:34:24.162929 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-d335f750-9cf1-44b2-b926-4bf785de1080 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:24.163529 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-d335f750-9cf1-44b2-b926-4bf785de1080 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:24.169609 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d335f750-9cf1-44b2-b926-4bf785de1080 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:24.170051 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d335f750-9cf1-44b2-b926-4bf785de1080 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:24.170846 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d335f750-9cf1-44b2-b926-4bf785de1080 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:24.171274 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d335f750-9cf1-44b2-b926-4bf785de1080 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:24.296330 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-d335f750-9cf1-44b2-b926-4bf785de1080 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:24.303539 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-d335f750-9cf1-44b2-b926-4bf785de1080 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1578 microversion: 2.1 time: 0.143975 Oct 19 08:34:24.304097 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 726/1429] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:24 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1578 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:34:24.586423 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-983401ba-7e68-4d10-9b24-d0595d88cc65 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:24.587072 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-983401ba-7e68-4d10-9b24-d0595d88cc65 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:24.593085 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-983401ba-7e68-4d10-9b24-d0595d88cc65 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:24.593536 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-983401ba-7e68-4d10-9b24-d0595d88cc65 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:24.594302 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-983401ba-7e68-4d10-9b24-d0595d88cc65 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:24.594764 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-983401ba-7e68-4d10-9b24-d0595d88cc65 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:24.720921 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-983401ba-7e68-4d10-9b24-d0595d88cc65 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:24.728116 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-983401ba-7e68-4d10-9b24-d0595d88cc65 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1569 microversion: 2.1 time: 0.145310 Oct 19 08:34:24.728670 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 727/1430] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:24 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1569 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:34:25.169707 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-331a4729-b4ad-4432-abb7-b3e75a4caa1f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:25.170434 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-331a4729-b4ad-4432-abb7-b3e75a4caa1f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:25.176574 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-331a4729-b4ad-4432-abb7-b3e75a4caa1f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:25.177014 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-331a4729-b4ad-4432-abb7-b3e75a4caa1f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:25.177774 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-331a4729-b4ad-4432-abb7-b3e75a4caa1f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:25.178195 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-331a4729-b4ad-4432-abb7-b3e75a4caa1f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:25.310263 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-331a4729-b4ad-4432-abb7-b3e75a4caa1f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:25.318231 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-331a4729-b4ad-4432-abb7-b3e75a4caa1f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:25.319748 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-331a4729-b4ad-4432-abb7-b3e75a4caa1f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:25.320904 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-331a4729-b4ad-4432-abb7-b3e75a4caa1f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1731 microversion: 2.20 time: 0.156156 Oct 19 08:34:25.321451 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 728/1431] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:25 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:34:25.325609 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-03f34d74-1613-4e95-b112-be92820917f4 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:25.326202 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-03f34d74-1613-4e95-b112-be92820917f4 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:25.331593 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-03f34d74-1613-4e95-b112-be92820917f4 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:25.332032 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-03f34d74-1613-4e95-b112-be92820917f4 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:25.332783 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-03f34d74-1613-4e95-b112-be92820917f4 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:25.333210 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-03f34d74-1613-4e95-b112-be92820917f4 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:25.467146 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-03f34d74-1613-4e95-b112-be92820917f4 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:25.474764 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-03f34d74-1613-4e95-b112-be92820917f4 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1578 microversion: 2.1 time: 0.152351 Oct 19 08:34:25.475323 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 729/1432] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:25 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1578 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:25.749336 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-1e65549a-0e45-4c07-9a8d-829d7a3b12a6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:25.750109 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-1e65549a-0e45-4c07-9a8d-829d7a3b12a6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:25.756838 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1e65549a-0e45-4c07-9a8d-829d7a3b12a6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:25.757370 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1e65549a-0e45-4c07-9a8d-829d7a3b12a6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:25.758222 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1e65549a-0e45-4c07-9a8d-829d7a3b12a6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:25.758802 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1e65549a-0e45-4c07-9a8d-829d7a3b12a6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:25.887636 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-1e65549a-0e45-4c07-9a8d-829d7a3b12a6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:25.895515 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-1e65549a-0e45-4c07-9a8d-829d7a3b12a6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1569 microversion: 2.1 time: 0.152301 Oct 19 08:34:25.896072 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 730/1433] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:25 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:26.338855 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c834f386-4b95-4da8-8f0d-1b43d3ce4d80 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:26.339640 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c834f386-4b95-4da8-8f0d-1b43d3ce4d80 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:26.346852 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c834f386-4b95-4da8-8f0d-1b43d3ce4d80 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:26.346852 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c834f386-4b95-4da8-8f0d-1b43d3ce4d80 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:26.347554 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c834f386-4b95-4da8-8f0d-1b43d3ce4d80 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:26.347946 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c834f386-4b95-4da8-8f0d-1b43d3ce4d80 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:26.488549 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-c834f386-4b95-4da8-8f0d-1b43d3ce4d80 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:26.509413 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-c834f386-4b95-4da8-8f0d-1b43d3ce4d80 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:26.510962 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-c834f386-4b95-4da8-8f0d-1b43d3ce4d80 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:26.514188 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c834f386-4b95-4da8-8f0d-1b43d3ce4d80 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1731 microversion: 2.20 time: 0.178799 Oct 19 08:34:26.516513 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 731/1434] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:26 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:34:26.526557 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-7156832b-6339-4bc2-85b1-4a2810710929 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:26.527710 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-7156832b-6339-4bc2-85b1-4a2810710929 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:26.539345 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7156832b-6339-4bc2-85b1-4a2810710929 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:26.539786 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7156832b-6339-4bc2-85b1-4a2810710929 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:26.540558 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7156832b-6339-4bc2-85b1-4a2810710929 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:26.540987 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7156832b-6339-4bc2-85b1-4a2810710929 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:26.670019 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-7156832b-6339-4bc2-85b1-4a2810710929 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:26.677316 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-7156832b-6339-4bc2-85b1-4a2810710929 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1578 microversion: 2.1 time: 0.160098 Oct 19 08:34:26.677882 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 732/1435] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:26 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:26.912996 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-dbaba592-7acd-4416-bfa1-a4e25562a8ba tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:26.913470 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-dbaba592-7acd-4416-bfa1-a4e25562a8ba tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:26.919889 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-dbaba592-7acd-4416-bfa1-a4e25562a8ba tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:26.920325 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-dbaba592-7acd-4416-bfa1-a4e25562a8ba tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:26.921075 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-dbaba592-7acd-4416-bfa1-a4e25562a8ba tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:26.921501 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-dbaba592-7acd-4416-bfa1-a4e25562a8ba tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:27.045005 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-dbaba592-7acd-4416-bfa1-a4e25562a8ba tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:27.053491 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-dbaba592-7acd-4416-bfa1-a4e25562a8ba tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1569 microversion: 2.1 time: 0.144161 Oct 19 08:34:27.054370 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 733/1436] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:26 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1569 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:34:27.536832 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-7646989b-069f-42da-b3c3-8a660d2b8c30 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:27.537533 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-7646989b-069f-42da-b3c3-8a660d2b8c30 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:27.543309 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7646989b-069f-42da-b3c3-8a660d2b8c30 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:27.543759 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7646989b-069f-42da-b3c3-8a660d2b8c30 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:27.545129 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7646989b-069f-42da-b3c3-8a660d2b8c30 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:27.545577 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7646989b-069f-42da-b3c3-8a660d2b8c30 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:27.675904 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-7646989b-069f-42da-b3c3-8a660d2b8c30 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:27.683637 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-7646989b-069f-42da-b3c3-8a660d2b8c30 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:27.685148 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-7646989b-069f-42da-b3c3-8a660d2b8c30 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:27.686333 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-7646989b-069f-42da-b3c3-8a660d2b8c30 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1731 microversion: 2.20 time: 0.153227 Oct 19 08:34:27.686922 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 734/1437] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:27 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:34:27.694481 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-8dde6765-d69b-41a7-865c-1ab114e36395 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:27.695100 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-8dde6765-d69b-41a7-865c-1ab114e36395 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:27.700557 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8dde6765-d69b-41a7-865c-1ab114e36395 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:27.702111 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8dde6765-d69b-41a7-865c-1ab114e36395 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:27.702891 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8dde6765-d69b-41a7-865c-1ab114e36395 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:27.703317 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8dde6765-d69b-41a7-865c-1ab114e36395 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:27.832296 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-8dde6765-d69b-41a7-865c-1ab114e36395 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:27.850368 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-8dde6765-d69b-41a7-865c-1ab114e36395 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1578 microversion: 2.1 time: 0.159112 Oct 19 08:34:27.851187 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 735/1438] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:27 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:34:28.071358 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-cffe3b11-92ac-4da9-8efd-bc1c43b6559e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:28.071974 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-cffe3b11-92ac-4da9-8efd-bc1c43b6559e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:28.078700 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cffe3b11-92ac-4da9-8efd-bc1c43b6559e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:28.079150 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cffe3b11-92ac-4da9-8efd-bc1c43b6559e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:28.079911 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cffe3b11-92ac-4da9-8efd-bc1c43b6559e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:28.080343 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cffe3b11-92ac-4da9-8efd-bc1c43b6559e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:28.201989 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-cffe3b11-92ac-4da9-8efd-bc1c43b6559e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:28.209322 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-cffe3b11-92ac-4da9-8efd-bc1c43b6559e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1569 microversion: 2.1 time: 0.141688 Oct 19 08:34:28.209883 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 736/1439] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:28 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1569 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:34:28.705459 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-d3a9be67-c586-417a-bceb-1f1cf278cfca tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:28.706111 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-d3a9be67-c586-417a-bceb-1f1cf278cfca tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:28.711962 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d3a9be67-c586-417a-bceb-1f1cf278cfca tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:28.712401 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d3a9be67-c586-417a-bceb-1f1cf278cfca tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:28.713156 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d3a9be67-c586-417a-bceb-1f1cf278cfca tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:28.713575 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d3a9be67-c586-417a-bceb-1f1cf278cfca tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:28.843162 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-d3a9be67-c586-417a-bceb-1f1cf278cfca tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:28.862129 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-d3a9be67-c586-417a-bceb-1f1cf278cfca tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:28.863658 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-d3a9be67-c586-417a-bceb-1f1cf278cfca tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:28.864836 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-d3a9be67-c586-417a-bceb-1f1cf278cfca tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1731 microversion: 2.20 time: 0.163846 Oct 19 08:34:28.865394 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 737/1440] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:28 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:34:28.869606 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-aa88f9ae-0d81-4c48-89b1-1bd529abac21 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:28.870203 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-aa88f9ae-0d81-4c48-89b1-1bd529abac21 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:28.876080 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-aa88f9ae-0d81-4c48-89b1-1bd529abac21 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:28.876527 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-aa88f9ae-0d81-4c48-89b1-1bd529abac21 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:28.877296 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-aa88f9ae-0d81-4c48-89b1-1bd529abac21 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:28.877722 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-aa88f9ae-0d81-4c48-89b1-1bd529abac21 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:29.011614 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-aa88f9ae-0d81-4c48-89b1-1bd529abac21 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:29.020164 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-aa88f9ae-0d81-4c48-89b1-1bd529abac21 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1578 microversion: 2.1 time: 0.153802 Oct 19 08:34:29.020957 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 738/1441] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:28 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:29.226402 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ef66f1ef-a953-47fd-9d6e-a748ced14180 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:29.226948 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ef66f1ef-a953-47fd-9d6e-a748ced14180 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:29.233174 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ef66f1ef-a953-47fd-9d6e-a748ced14180 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:29.233608 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ef66f1ef-a953-47fd-9d6e-a748ced14180 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:29.234403 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ef66f1ef-a953-47fd-9d6e-a748ced14180 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:29.234858 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ef66f1ef-a953-47fd-9d6e-a748ced14180 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:29.361793 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ef66f1ef-a953-47fd-9d6e-a748ced14180 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:29.369351 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ef66f1ef-a953-47fd-9d6e-a748ced14180 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1569 microversion: 2.1 time: 0.146787 Oct 19 08:34:29.369914 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 739/1442] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:29 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:34:29.882694 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ee386ad8-b8d7-4ab7-9827-fc46ac93e971 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:29.883337 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ee386ad8-b8d7-4ab7-9827-fc46ac93e971 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:29.889620 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ee386ad8-b8d7-4ab7-9827-fc46ac93e971 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:29.890072 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ee386ad8-b8d7-4ab7-9827-fc46ac93e971 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:29.890868 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ee386ad8-b8d7-4ab7-9827-fc46ac93e971 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:29.891301 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ee386ad8-b8d7-4ab7-9827-fc46ac93e971 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:30.015725 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ee386ad8-b8d7-4ab7-9827-fc46ac93e971 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:30.023860 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ee386ad8-b8d7-4ab7-9827-fc46ac93e971 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:30.025363 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ee386ad8-b8d7-4ab7-9827-fc46ac93e971 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:30.026572 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ee386ad8-b8d7-4ab7-9827-fc46ac93e971 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1731 microversion: 2.20 time: 0.147645 Oct 19 08:34:30.027455 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 740/1443] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:29 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:34:30.038363 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-1b94ec4a-e59f-40be-ba2b-0d5d14539d09 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:30.039454 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-1b94ec4a-e59f-40be-ba2b-0d5d14539d09 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:30.047083 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1b94ec4a-e59f-40be-ba2b-0d5d14539d09 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:30.047679 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1b94ec4a-e59f-40be-ba2b-0d5d14539d09 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:30.048604 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1b94ec4a-e59f-40be-ba2b-0d5d14539d09 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:30.049103 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1b94ec4a-e59f-40be-ba2b-0d5d14539d09 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:30.179828 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-1b94ec4a-e59f-40be-ba2b-0d5d14539d09 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:30.187443 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-1b94ec4a-e59f-40be-ba2b-0d5d14539d09 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1578 microversion: 2.1 time: 0.152931 Oct 19 08:34:30.188011 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 741/1444] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:30 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:30.386643 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-6729c491-b04a-4b9c-90d3-48efac04d92f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:30.387167 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-6729c491-b04a-4b9c-90d3-48efac04d92f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:30.394322 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6729c491-b04a-4b9c-90d3-48efac04d92f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:30.396279 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6729c491-b04a-4b9c-90d3-48efac04d92f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:30.396279 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6729c491-b04a-4b9c-90d3-48efac04d92f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:30.396532 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6729c491-b04a-4b9c-90d3-48efac04d92f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:30.524756 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-6729c491-b04a-4b9c-90d3-48efac04d92f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:30.532040 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-6729c491-b04a-4b9c-90d3-48efac04d92f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1569 microversion: 2.1 time: 0.149212 Oct 19 08:34:30.532603 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 742/1445] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:30 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:34:31.045242 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-2dc02e66-3141-4edb-9b13-3b989d313b93 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:31.046304 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-2dc02e66-3141-4edb-9b13-3b989d313b93 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:31.054273 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2dc02e66-3141-4edb-9b13-3b989d313b93 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:31.054766 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2dc02e66-3141-4edb-9b13-3b989d313b93 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:31.055535 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2dc02e66-3141-4edb-9b13-3b989d313b93 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:31.055954 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2dc02e66-3141-4edb-9b13-3b989d313b93 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:31.180224 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-2dc02e66-3141-4edb-9b13-3b989d313b93 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:31.188465 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-2dc02e66-3141-4edb-9b13-3b989d313b93 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:31.189973 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-2dc02e66-3141-4edb-9b13-3b989d313b93 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:31.191152 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-2dc02e66-3141-4edb-9b13-3b989d313b93 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1731 microversion: 2.20 time: 0.149987 Oct 19 08:34:31.191738 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 743/1446] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:31 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:34:31.204404 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-123e41bb-368d-4730-ae84-4ee6ac4a2c17 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:31.204997 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-123e41bb-368d-4730-ae84-4ee6ac4a2c17 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:31.210457 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-123e41bb-368d-4730-ae84-4ee6ac4a2c17 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:31.210936 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-123e41bb-368d-4730-ae84-4ee6ac4a2c17 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:31.211680 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-123e41bb-368d-4730-ae84-4ee6ac4a2c17 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:31.212103 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-123e41bb-368d-4730-ae84-4ee6ac4a2c17 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:31.335003 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-123e41bb-368d-4730-ae84-4ee6ac4a2c17 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:31.342758 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-123e41bb-368d-4730-ae84-4ee6ac4a2c17 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1578 microversion: 2.1 time: 0.142819 Oct 19 08:34:31.343313 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 744/1447] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:31 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1578 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:34:31.549668 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e028cfd9-b0cc-4655-9beb-fa71f0c17d73 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:31.550197 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e028cfd9-b0cc-4655-9beb-fa71f0c17d73 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:31.556201 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e028cfd9-b0cc-4655-9beb-fa71f0c17d73 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:31.556639 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e028cfd9-b0cc-4655-9beb-fa71f0c17d73 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:31.557387 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e028cfd9-b0cc-4655-9beb-fa71f0c17d73 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:31.557802 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e028cfd9-b0cc-4655-9beb-fa71f0c17d73 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:31.676704 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-e028cfd9-b0cc-4655-9beb-fa71f0c17d73 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:31.683822 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e028cfd9-b0cc-4655-9beb-fa71f0c17d73 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1569 microversion: 2.1 time: 0.137935 Oct 19 08:34:31.684374 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 745/1448] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:31 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:34:32.209594 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-3d640619-b7d8-4955-b217-c6b6e2526af5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:32.210229 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-3d640619-b7d8-4955-b217-c6b6e2526af5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:32.215926 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3d640619-b7d8-4955-b217-c6b6e2526af5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:32.217016 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3d640619-b7d8-4955-b217-c6b6e2526af5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:32.217775 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3d640619-b7d8-4955-b217-c6b6e2526af5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:32.218227 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-3d640619-b7d8-4955-b217-c6b6e2526af5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:32.335016 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3d640619-b7d8-4955-b217-c6b6e2526af5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:32.342873 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3d640619-b7d8-4955-b217-c6b6e2526af5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:32.344379 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-3d640619-b7d8-4955-b217-c6b6e2526af5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:32.345532 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-3d640619-b7d8-4955-b217-c6b6e2526af5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1731 microversion: 2.20 time: 0.139770 Oct 19 08:34:32.346088 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 746/1449] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:32 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1731 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:34:32.359745 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-86f5e11d-5003-447a-9c85-a10e4b1af9ca tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:32.360343 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-86f5e11d-5003-447a-9c85-a10e4b1af9ca tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:32.365984 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-86f5e11d-5003-447a-9c85-a10e4b1af9ca tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:32.366429 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-86f5e11d-5003-447a-9c85-a10e4b1af9ca tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:32.367232 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-86f5e11d-5003-447a-9c85-a10e4b1af9ca tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:32.367664 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-86f5e11d-5003-447a-9c85-a10e4b1af9ca tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:32.491397 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-86f5e11d-5003-447a-9c85-a10e4b1af9ca tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:32.499566 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-86f5e11d-5003-447a-9c85-a10e4b1af9ca tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1578 microversion: 2.1 time: 0.143705 Oct 19 08:34:32.500131 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 747/1450] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:32 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1578 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:34:32.701615 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-7f01e16a-05e0-49f0-a986-abcd8c099003 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:32.702218 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-7f01e16a-05e0-49f0-a986-abcd8c099003 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:32.708015 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7f01e16a-05e0-49f0-a986-abcd8c099003 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:32.708464 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7f01e16a-05e0-49f0-a986-abcd8c099003 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:32.709227 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7f01e16a-05e0-49f0-a986-abcd8c099003 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:32.709674 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7f01e16a-05e0-49f0-a986-abcd8c099003 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:32.828905 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-7f01e16a-05e0-49f0-a986-abcd8c099003 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:32.836203 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-7f01e16a-05e0-49f0-a986-abcd8c099003 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1569 microversion: 2.1 time: 0.138733 Oct 19 08:34:32.836987 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 748/1451] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:32 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:34:33.363883 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-0aeb7d80-d3d6-42d4-a063-b419f91e9184 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:33.364521 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-0aeb7d80-d3d6-42d4-a063-b419f91e9184 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:33.370199 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0aeb7d80-d3d6-42d4-a063-b419f91e9184 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:33.370697 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0aeb7d80-d3d6-42d4-a063-b419f91e9184 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:33.371455 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0aeb7d80-d3d6-42d4-a063-b419f91e9184 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:33.371882 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0aeb7d80-d3d6-42d4-a063-b419f91e9184 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:33.491194 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-0aeb7d80-d3d6-42d4-a063-b419f91e9184 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:33.498881 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-0aeb7d80-d3d6-42d4-a063-b419f91e9184 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:33.500365 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-0aeb7d80-d3d6-42d4-a063-b419f91e9184 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:33.501504 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-0aeb7d80-d3d6-42d4-a063-b419f91e9184 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1731 microversion: 2.20 time: 0.141264 Oct 19 08:34:33.502049 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 749/1452] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:33 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1731 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:34:33.516263 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-bfe1b1a9-9702-4b91-831f-64862f16f6ff tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:33.516864 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-bfe1b1a9-9702-4b91-831f-64862f16f6ff tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:33.522433 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bfe1b1a9-9702-4b91-831f-64862f16f6ff tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:33.522914 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bfe1b1a9-9702-4b91-831f-64862f16f6ff tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:33.523692 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bfe1b1a9-9702-4b91-831f-64862f16f6ff tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:33.524110 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-bfe1b1a9-9702-4b91-831f-64862f16f6ff tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:33.645538 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-bfe1b1a9-9702-4b91-831f-64862f16f6ff tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:33.652708 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-bfe1b1a9-9702-4b91-831f-64862f16f6ff tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1578 microversion: 2.1 time: 0.140177 Oct 19 08:34:33.653277 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 750/1453] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:33 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1578 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:33.852652 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a7f43515-64ac-491e-8812-9ad44ce3ba84 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:33.853260 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a7f43515-64ac-491e-8812-9ad44ce3ba84 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:33.859542 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a7f43515-64ac-491e-8812-9ad44ce3ba84 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:33.859985 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a7f43515-64ac-491e-8812-9ad44ce3ba84 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:33.860749 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a7f43515-64ac-491e-8812-9ad44ce3ba84 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:33.861178 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a7f43515-64ac-491e-8812-9ad44ce3ba84 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:33.968879 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-c49ecef6-f1da-4502-a6ab-f4b97b8f6129 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action" status: 200 len: 38275 microversion: 2.1 time: 15.345721 Oct 19 08:34:33.973457 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 704/1454] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:34:18 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/action => generated 38275 bytes in 15348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:34:33.980606 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-4f4e08d3-d058-4af4-8839-4b6df774497c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:33.981169 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-4f4e08d3-d058-4af4-8839-4b6df774497c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:33.987880 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4f4e08d3-d058-4af4-8839-4b6df774497c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:33.988321 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4f4e08d3-d058-4af4-8839-4b6df774497c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:33.989260 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4f4e08d3-d058-4af4-8839-4b6df774497c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:33.989792 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4f4e08d3-d058-4af4-8839-4b6df774497c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:33.992881 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a7f43515-64ac-491e-8812-9ad44ce3ba84 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:34.001280 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a7f43515-64ac-491e-8812-9ad44ce3ba84 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1569 microversion: 2.1 time: 0.152147 Oct 19 08:34:34.001860 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 751/1455] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:33 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:34:34.017382 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-4f4e08d3-d058-4af4-8839-4b6df774497c tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/ips" status: 200 len: 145 microversion: 2.1 time: 0.040834 Oct 19 08:34:34.017976 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 705/1456] 10.222.0.26 () {58 vars in 1247 bytes} [Tue Oct 19 08:34:33 2021] GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:34:34.519966 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ebdeb389-baa1-43d7-a4e3-a9cc8ec144b8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:34.520525 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ebdeb389-baa1-43d7-a4e3-a9cc8ec144b8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:34.526211 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ebdeb389-baa1-43d7-a4e3-a9cc8ec144b8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:34.526700 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ebdeb389-baa1-43d7-a4e3-a9cc8ec144b8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:34.527463 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ebdeb389-baa1-43d7-a4e3-a9cc8ec144b8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:34.527887 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ebdeb389-baa1-43d7-a4e3-a9cc8ec144b8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:34.669080 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-e53cbc0f-12b5-4c56-9d30-8ea19f24011f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:34.670236 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-e53cbc0f-12b5-4c56-9d30-8ea19f24011f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:34.676068 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e53cbc0f-12b5-4c56-9d30-8ea19f24011f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:34.676350 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e53cbc0f-12b5-4c56-9d30-8ea19f24011f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:34.677098 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e53cbc0f-12b5-4c56-9d30-8ea19f24011f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:34.677519 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-e53cbc0f-12b5-4c56-9d30-8ea19f24011f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:34.857609 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ebdeb389-baa1-43d7-a4e3-a9cc8ec144b8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:34.865417 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ebdeb389-baa1-43d7-a4e3-a9cc8ec144b8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:34.866934 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ebdeb389-baa1-43d7-a4e3-a9cc8ec144b8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:34.868084 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ebdeb389-baa1-43d7-a4e3-a9cc8ec144b8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1731 microversion: 2.20 time: 0.352055 Oct 19 08:34:34.868642 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 752/1457] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:34 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1731 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:34:35.019102 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c733cfab-5f3b-4f18-98bb-d62510a2d6a9 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:35.019722 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c733cfab-5f3b-4f18-98bb-d62510a2d6a9 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:35.025398 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c733cfab-5f3b-4f18-98bb-d62510a2d6a9 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:35.025840 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c733cfab-5f3b-4f18-98bb-d62510a2d6a9 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:35.026629 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c733cfab-5f3b-4f18-98bb-d62510a2d6a9 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:35.027058 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c733cfab-5f3b-4f18-98bb-d62510a2d6a9 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:35.059338 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-e53cbc0f-12b5-4c56-9d30-8ea19f24011f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:35.066644 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-e53cbc0f-12b5-4c56-9d30-8ea19f24011f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1578 microversion: 2.1 time: 0.401127 Oct 19 08:34:35.067202 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 706/1458] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:34 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1578 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:35.218232 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-c733cfab-5f3b-4f18-98bb-d62510a2d6a9 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:35.225672 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c733cfab-5f3b-4f18-98bb-d62510a2d6a9 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1569 microversion: 2.1 time: 0.210316 Oct 19 08:34:35.226325 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 753/1459] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:35 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1569 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:34:35.323432 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-b1c25ad5-92e1-4841-8af3-43f0c2043733 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fcccfbc1-834c-4a80-b0f1-7e9c72410d37"}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:35.324481 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-b1c25ad5-92e1-4841-8af3-43f0c2043733 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:35.330246 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b1c25ad5-92e1-4841-8af3-43f0c2043733 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:35.330726 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b1c25ad5-92e1-4841-8af3-43f0c2043733 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:35.331483 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b1c25ad5-92e1-4841-8af3-43f0c2043733 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:35.331913 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b1c25ad5-92e1-4841-8af3-43f0c2043733 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:35.561646 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-b1c25ad5-92e1-4841-8af3-43f0c2043733 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.241664 Oct 19 08:34:35.562164 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 707/1460] 10.222.0.26 () {60 vars in 1322 bytes} [Tue Oct 19 08:34:35 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/os-volume_attachments => generated 194 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:34:35.886171 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-f8538eae-13e6-458c-8b28-1bc965fa4a1a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:35.886829 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-f8538eae-13e6-458c-8b28-1bc965fa4a1a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:35.892937 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f8538eae-13e6-458c-8b28-1bc965fa4a1a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:35.893389 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f8538eae-13e6-458c-8b28-1bc965fa4a1a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:35.894192 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f8538eae-13e6-458c-8b28-1bc965fa4a1a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:35.894720 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f8538eae-13e6-458c-8b28-1bc965fa4a1a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:36.069943 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-f8538eae-13e6-458c-8b28-1bc965fa4a1a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:36.077972 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-f8538eae-13e6-458c-8b28-1bc965fa4a1a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:36.079565 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-f8538eae-13e6-458c-8b28-1bc965fa4a1a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:36.080720 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-f8538eae-13e6-458c-8b28-1bc965fa4a1a tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1731 microversion: 2.20 time: 0.198308 Oct 19 08:34:36.081267 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 754/1461] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:35 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1731 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:34:36.084904 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-a5c70e58-3eb4-460a-9b80-e7af22fdc749 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:36.085704 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-a5c70e58-3eb4-460a-9b80-e7af22fdc749 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:36.092503 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a5c70e58-3eb4-460a-9b80-e7af22fdc749 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:36.093028 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a5c70e58-3eb4-460a-9b80-e7af22fdc749 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:36.093907 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a5c70e58-3eb4-460a-9b80-e7af22fdc749 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:36.094336 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a5c70e58-3eb4-460a-9b80-e7af22fdc749 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:36.243141 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-17193f5b-588d-448d-8af8-44e30aba4697 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:36.243755 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-17193f5b-588d-448d-8af8-44e30aba4697 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:36.250983 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-17193f5b-588d-448d-8af8-44e30aba4697 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:36.251424 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-17193f5b-588d-448d-8af8-44e30aba4697 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:36.252193 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-17193f5b-588d-448d-8af8-44e30aba4697 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:36.252619 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-17193f5b-588d-448d-8af8-44e30aba4697 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:36.542430 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-a5c70e58-3eb4-460a-9b80-e7af22fdc749 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:36.546157 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-17193f5b-588d-448d-8af8-44e30aba4697 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:36.550914 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-a5c70e58-3eb4-460a-9b80-e7af22fdc749 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1578 microversion: 2.1 time: 0.470211 Oct 19 08:34:36.560700 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 708/1462] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:36 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1578 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:36.560919 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-17193f5b-588d-448d-8af8-44e30aba4697 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1569 microversion: 2.1 time: 0.315112 Oct 19 08:34:36.560919 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 755/1463] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:36 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1569 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:34:36.924933 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-011fac8c-f911-44d3-98e9-561452f64614 req-7e99ba25-9c57-4dd9-93b0-a129f02ebd90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9802a026-2641-4cdf-9d05-97a5272d6d8b", "name": "network-vif-deleted", "tag": "ff26f079-abb3-425c-828c-e1118d527879"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:36.926569 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:34:36.926569 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:34:36.936162 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-011fac8c-f911-44d3-98e9-561452f64614 req-7e99ba25-9c57-4dd9-93b0-a129f02ebd90 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:36.936719 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-011fac8c-f911-44d3-98e9-561452f64614 req-7e99ba25-9c57-4dd9-93b0-a129f02ebd90 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:36.948520 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-011fac8c-f911-44d3-98e9-561452f64614 req-7e99ba25-9c57-4dd9-93b0-a129f02ebd90 service nova] Creating event network-vif-deleted:ff26f079-abb3-425c-828c-e1118d527879 for instance 9802a026-2641-4cdf-9d05-97a5272d6d8b on hv-cinder-81398 Oct 19 08:34:36.955659 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-011fac8c-f911-44d3-98e9-561452f64614 req-7e99ba25-9c57-4dd9-93b0-a129f02ebd90 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034472 Oct 19 08:34:36.959127 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 709/1464] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:34:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:34:37.099663 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ecb013ef-ed85-4ed5-93ce-c2607c9c793f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:37.100383 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ecb013ef-ed85-4ed5-93ce-c2607c9c793f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:37.108072 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ecb013ef-ed85-4ed5-93ce-c2607c9c793f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:37.113523 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ecb013ef-ed85-4ed5-93ce-c2607c9c793f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:37.114444 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ecb013ef-ed85-4ed5-93ce-c2607c9c793f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:37.114971 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ecb013ef-ed85-4ed5-93ce-c2607c9c793f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:37.251213 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ecb013ef-ed85-4ed5-93ce-c2607c9c793f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:37.264559 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ecb013ef-ed85-4ed5-93ce-c2607c9c793f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:37.266800 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ecb013ef-ed85-4ed5-93ce-c2607c9c793f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:37.270373 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ecb013ef-ed85-4ed5-93ce-c2607c9c793f tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1731 microversion: 2.20 time: 0.174251 Oct 19 08:34:37.271850 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 756/1465] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:37 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:34:37.573748 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-190d230d-0ffa-4082-87fc-91d30711314f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:37.574441 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-04b0c580-1cc4-4383-83a8-591ba0aab9b2 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:37.575188 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-04b0c580-1cc4-4383-83a8-591ba0aab9b2 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:37.576627 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-190d230d-0ffa-4082-87fc-91d30711314f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:37.587235 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-04b0c580-1cc4-4383-83a8-591ba0aab9b2 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:37.587770 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-04b0c580-1cc4-4383-83a8-591ba0aab9b2 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:37.590584 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-04b0c580-1cc4-4383-83a8-591ba0aab9b2 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:37.591017 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-04b0c580-1cc4-4383-83a8-591ba0aab9b2 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:37.592842 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-190d230d-0ffa-4082-87fc-91d30711314f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:37.593290 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-190d230d-0ffa-4082-87fc-91d30711314f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:37.594072 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-190d230d-0ffa-4082-87fc-91d30711314f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:37.594526 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-190d230d-0ffa-4082-87fc-91d30711314f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:37.646977 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-190d230d-0ffa-4082-87fc-91d30711314f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:37.647423 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-190d230d-0ffa-4082-87fc-91d30711314f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:37.647867 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.objects.instance [None req-190d230d-0ffa-4082-87fc-91d30711314f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lazy-loading 'fault' on Instance uuid 9802a026-2641-4cdf-9d05-97a5272d6d8b {{(pid=114105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 19 08:34:37.712844 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-190d230d-0ffa-4082-87fc-91d30711314f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:37.721326 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-190d230d-0ffa-4082-87fc-91d30711314f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 200 len: 1184 microversion: 2.1 time: 0.156581 Oct 19 08:34:37.722108 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 710/1466] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:37 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 1184 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:37.788433 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-04b0c580-1cc4-4383-83a8-591ba0aab9b2 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:37.801700 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-04b0c580-1cc4-4383-83a8-591ba0aab9b2 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1570 microversion: 2.1 time: 0.232734 Oct 19 08:34:37.802196 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 757/1467] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:37 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1570 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:34:37.818815 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-51ca255e-e732-4265-b856-c69b01656907 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:37.819410 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-51ca255e-e732-4265-b856-c69b01656907 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:37.825521 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-51ca255e-e732-4265-b856-c69b01656907 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:37.826383 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-51ca255e-e732-4265-b856-c69b01656907 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:37.827039 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-51ca255e-e732-4265-b856-c69b01656907 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:37.827470 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-51ca255e-e732-4265-b856-c69b01656907 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:37.908114 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-51ca255e-e732-4265-b856-c69b01656907 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "POST /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986/action" status: 202 len: 0 microversion: 2.1 time: 0.092967 Oct 19 08:34:37.908993 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 711/1468] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:34:37 2021] POST /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:34:37.917010 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-140dfb9b-f85f-4099-a9fd-f7dd16a631ae tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:37.917833 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-140dfb9b-f85f-4099-a9fd-f7dd16a631ae tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:37.925008 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-140dfb9b-f85f-4099-a9fd-f7dd16a631ae tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:37.925837 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-140dfb9b-f85f-4099-a9fd-f7dd16a631ae tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:37.926828 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-140dfb9b-f85f-4099-a9fd-f7dd16a631ae tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:37.927437 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-140dfb9b-f85f-4099-a9fd-f7dd16a631ae tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:38.071170 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-140dfb9b-f85f-4099-a9fd-f7dd16a631ae tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:38.079115 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-140dfb9b-f85f-4099-a9fd-f7dd16a631ae tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1578 microversion: 2.1 time: 0.165510 Oct 19 08:34:38.080358 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 758/1469] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:37 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:34:38.288847 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-91a3bb26-59df-482e-b520-ff2771a14542 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:38.289668 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-91a3bb26-59df-482e-b520-ff2771a14542 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:38.296103 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-91a3bb26-59df-482e-b520-ff2771a14542 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:38.296609 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-91a3bb26-59df-482e-b520-ff2771a14542 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:38.297447 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-91a3bb26-59df-482e-b520-ff2771a14542 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:38.297957 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-91a3bb26-59df-482e-b520-ff2771a14542 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:38.424804 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-91a3bb26-59df-482e-b520-ff2771a14542 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:38.432408 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-91a3bb26-59df-482e-b520-ff2771a14542 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:38.433909 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-91a3bb26-59df-482e-b520-ff2771a14542 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:38.435693 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-91a3bb26-59df-482e-b520-ff2771a14542 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1731 microversion: 2.20 time: 0.150042 Oct 19 08:34:38.436449 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 712/1470] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:38 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:34:38.738283 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a3d82918-ad92-4026-bd05-c6520eed5f88 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:38.739014 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a3d82918-ad92-4026-bd05-c6520eed5f88 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:38.744767 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a3d82918-ad92-4026-bd05-c6520eed5f88 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:38.745212 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a3d82918-ad92-4026-bd05-c6520eed5f88 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:38.745971 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a3d82918-ad92-4026-bd05-c6520eed5f88 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:38.746421 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a3d82918-ad92-4026-bd05-c6520eed5f88 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:38.761418 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.wsgi [None req-a3d82918-ad92-4026-bd05-c6520eed5f88 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] HTTP exception thrown: Instance 9802a026-2641-4cdf-9d05-97a5272d6d8b could not be found. Oct 19 08:34:38.762126 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a3d82918-ad92-4026-bd05-c6520eed5f88 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Returning 404 to user: Instance 9802a026-2641-4cdf-9d05-97a5272d6d8b could not be found. {{(pid=114106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:34:38.763112 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a3d82918-ad92-4026-bd05-c6520eed5f88 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 404 len: 111 microversion: 2.1 time: 0.028564 Oct 19 08:34:38.764591 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 759/1471] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:38 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:34:38.817967 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-865d50e1-62ab-4c13-99de-21eef8ca7974 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1337264328", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-200438871", "security_groups": [{"name": "tempest-secgroup-smoke-740896653"}], "block_device_mapping_v2": [{"uuid": "36e0be22-0965-4a26-9d77-009121a7d2dd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "09e1e2e2-02ec-4078-9b6b-9e1d757336b7"}]}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:38.912179 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.network.neutron [None req-865d50e1-62ab-4c13-99de-21eef8ca7974 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] validate_networks() for [('09e1e2e2-02ec-4078-9b6b-9e1d757336b7', None, None, None, None, None)] {{(pid=114105) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 19 08:34:39.097340 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-71d7ca2b-0079-4b9d-977f-7a2f7a63b21d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:39.097863 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-71d7ca2b-0079-4b9d-977f-7a2f7a63b21d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:39.104906 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-71d7ca2b-0079-4b9d-977f-7a2f7a63b21d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:39.105368 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-71d7ca2b-0079-4b9d-977f-7a2f7a63b21d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:39.106531 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-71d7ca2b-0079-4b9d-977f-7a2f7a63b21d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:39.107464 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-71d7ca2b-0079-4b9d-977f-7a2f7a63b21d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:39.369056 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-71d7ca2b-0079-4b9d-977f-7a2f7a63b21d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:39.379584 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-71d7ca2b-0079-4b9d-977f-7a2f7a63b21d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1520 microversion: 2.1 time: 0.286378 Oct 19 08:34:39.380157 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 760/1472] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:39 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:34:39.452853 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a5323bdc-91db-4317-be08-460de2ab6882 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:39.453457 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a5323bdc-91db-4317-be08-460de2ab6882 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:39.459192 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a5323bdc-91db-4317-be08-460de2ab6882 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:39.459641 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a5323bdc-91db-4317-be08-460de2ab6882 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:39.460404 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a5323bdc-91db-4317-be08-460de2ab6882 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:39.460839 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a5323bdc-91db-4317-be08-460de2ab6882 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:39.661333 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a5323bdc-91db-4317-be08-460de2ab6882 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:39.669179 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a5323bdc-91db-4317-be08-460de2ab6882 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:39.671082 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a5323bdc-91db-4317-be08-460de2ab6882 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:39.672246 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a5323bdc-91db-4317-be08-460de2ab6882 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1731 microversion: 2.20 time: 0.223181 Oct 19 08:34:39.672793 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 761/1473] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:39 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1731 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:34:39.684277 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-865d50e1-62ab-4c13-99de-21eef8ca7974 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Flavor limits 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 08:34:39.684696 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-865d50e1-62ab-4c13-99de-21eef8ca7974 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Image limits 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 08:34:39.685446 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-865d50e1-62ab-4c13-99de-21eef8ca7974 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Flavor pref 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 08:34:39.685866 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-865d50e1-62ab-4c13-99de-21eef8ca7974 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Image pref 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 08:34:39.686303 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-865d50e1-62ab-4c13-99de-21eef8ca7974 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 08:34:39.694695 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-865d50e1-62ab-4c13-99de-21eef8ca7974 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:39.695139 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-865d50e1-62ab-4c13-99de-21eef8ca7974 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:39.695942 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-865d50e1-62ab-4c13-99de-21eef8ca7974 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:39.696374 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-865d50e1-62ab-4c13-99de-21eef8ca7974 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:39.712786 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-865d50e1-62ab-4c13-99de-21eef8ca7974 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Getting quotas for project 28ca19e490b045a8af80ce6bc64afa50. Resources: {'cores', 'instances', 'ram'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:34:39.717300 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-865d50e1-62ab-4c13-99de-21eef8ca7974 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Getting quotas for user 2c83b4f13a67443b90711ef61e4685a6 and project 28ca19e490b045a8af80ce6bc64afa50. Resources: {'cores', 'instances', 'ram'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:34:39.770447 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-865d50e1-62ab-4c13-99de-21eef8ca7974 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Going to run 1 instances... {{(pid=114105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 19 08:34:39.772585 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-865d50e1-62ab-4c13-99de-21eef8ca7974 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 532d2be2-d6f6-4402-b37b-574a504d3ab4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='36e0be22-0965-4a26-9d77-009121a7d2dd',volume_size=None,volume_type=None)] {{(pid=114105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 19 08:34:39.896509 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-865d50e1-62ab-4c13-99de-21eef8ca7974 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.082160 Oct 19 08:34:39.897215 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 713/1474] 10.222.0.26 () {60 vars in 1146 bytes} [Tue Oct 19 08:34:38 2021] POST /compute/v2.1/servers => generated 405 bytes in 1084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 08:34:39.907760 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-936acda4-2c7a-4760-98ec-f566372063a3 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:39.908366 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-936acda4-2c7a-4760-98ec-f566372063a3 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 532d2be2-d6f6-4402-b37b-574a504d3ab4] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:39.959101 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-936acda4-2c7a-4760-98ec-f566372063a3 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:39.965600 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-936acda4-2c7a-4760-98ec-f566372063a3 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4" status: 200 len: 1094 microversion: 2.1 time: 0.062085 Oct 19 08:34:39.966160 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 762/1475] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:39 2021] GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4 => generated 1094 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:40.396998 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-4f65127c-9cff-4921-a538-73945bdcd91d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:40.397723 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-4f65127c-9cff-4921-a538-73945bdcd91d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:40.404723 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4f65127c-9cff-4921-a538-73945bdcd91d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:40.405276 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4f65127c-9cff-4921-a538-73945bdcd91d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:40.406065 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4f65127c-9cff-4921-a538-73945bdcd91d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:40.406513 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-4f65127c-9cff-4921-a538-73945bdcd91d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:40.532057 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-4f65127c-9cff-4921-a538-73945bdcd91d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:40.539279 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-4f65127c-9cff-4921-a538-73945bdcd91d tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1520 microversion: 2.1 time: 0.145968 Oct 19 08:34:40.539828 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 714/1476] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:40 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:40.689935 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-4e198c42-65c8-45cf-b5fb-87bcfd28692c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:40.690671 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-4e198c42-65c8-45cf-b5fb-87bcfd28692c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:40.696836 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4e198c42-65c8-45cf-b5fb-87bcfd28692c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:40.697282 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4e198c42-65c8-45cf-b5fb-87bcfd28692c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:40.698049 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4e198c42-65c8-45cf-b5fb-87bcfd28692c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:40.698479 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4e198c42-65c8-45cf-b5fb-87bcfd28692c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:40.727427 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-969cae36-c2ce-4f2c-921c-093c00287fe5 req-03f14deb-9f6a-4f76-a0b5-55d46282a98f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15322fb9-3685-4ce3-9f4d-9a407835f47a", "name": "network-vif-plugged", "status": "completed", "tag": "5a96c138-97d6-476d-b751-ac066e4a3cef"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:40.729516 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:34:40.729516 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:34:40.739586 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-969cae36-c2ce-4f2c-921c-093c00287fe5 req-03f14deb-9f6a-4f76-a0b5-55d46282a98f service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:40.740189 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-969cae36-c2ce-4f2c-921c-093c00287fe5 req-03f14deb-9f6a-4f76-a0b5-55d46282a98f service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:40.754067 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-969cae36-c2ce-4f2c-921c-093c00287fe5 req-03f14deb-9f6a-4f76-a0b5-55d46282a98f service nova] Creating event network-vif-plugged:5a96c138-97d6-476d-b751-ac066e4a3cef for instance 15322fb9-3685-4ce3-9f4d-9a407835f47a on hv-cinder-81398 Oct 19 08:34:40.759267 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-969cae36-c2ce-4f2c-921c-093c00287fe5 req-03f14deb-9f6a-4f76-a0b5-55d46282a98f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035634 Oct 19 08:34:40.760264 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 715/1477] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:34:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:34:40.911702 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-4e198c42-65c8-45cf-b5fb-87bcfd28692c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:40.924674 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-4e198c42-65c8-45cf-b5fb-87bcfd28692c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:40.926928 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-4e198c42-65c8-45cf-b5fb-87bcfd28692c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:40.928163 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-4e198c42-65c8-45cf-b5fb-87bcfd28692c tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1731 microversion: 2.20 time: 0.241894 Oct 19 08:34:40.928654 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 763/1478] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:40 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1731 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:34:40.983441 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-16d9e25b-511a-433d-a4c6-58263a2c1760 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:40.984406 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-16d9e25b-511a-433d-a4c6-58263a2c1760 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 532d2be2-d6f6-4402-b37b-574a504d3ab4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:40.994070 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-16d9e25b-511a-433d-a4c6-58263a2c1760 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:40.994684 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-16d9e25b-511a-433d-a4c6-58263a2c1760 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:40.995646 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-16d9e25b-511a-433d-a4c6-58263a2c1760 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:40.996278 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-16d9e25b-511a-433d-a4c6-58263a2c1760 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:41.080116 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-16d9e25b-511a-433d-a4c6-58263a2c1760 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:41.087510 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-16d9e25b-511a-433d-a4c6-58263a2c1760 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4" status: 200 len: 1210 microversion: 2.1 time: 0.108710 Oct 19 08:34:41.088058 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 716/1479] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:40 2021] GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4 => generated 1210 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:41.557255 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-9b91f022-b0c2-482a-bd7a-c7fa99a36013 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:41.557866 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-9b91f022-b0c2-482a-bd7a-c7fa99a36013 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:41.563902 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9b91f022-b0c2-482a-bd7a-c7fa99a36013 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:41.564355 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9b91f022-b0c2-482a-bd7a-c7fa99a36013 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:41.565162 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9b91f022-b0c2-482a-bd7a-c7fa99a36013 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:41.565578 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9b91f022-b0c2-482a-bd7a-c7fa99a36013 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:41.762735 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-9b91f022-b0c2-482a-bd7a-c7fa99a36013 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:41.771049 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-9b91f022-b0c2-482a-bd7a-c7fa99a36013 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1520 microversion: 2.1 time: 0.217724 Oct 19 08:34:41.771634 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 764/1480] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:41 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:41.947020 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-9feb09f3-5f14-481d-a8c1-6b2856236f74 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:41.947747 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-9feb09f3-5f14-481d-a8c1-6b2856236f74 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:41.954180 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9feb09f3-5f14-481d-a8c1-6b2856236f74 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:41.954657 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9feb09f3-5f14-481d-a8c1-6b2856236f74 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:41.955432 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9feb09f3-5f14-481d-a8c1-6b2856236f74 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:41.955865 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9feb09f3-5f14-481d-a8c1-6b2856236f74 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:42.102393 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-9d0fc8ef-96e9-4e16-80d9-ed5a642f580f tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1985919572"}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:42.103737 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-9d0fc8ef-96e9-4e16-80d9-ed5a642f580f tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:42.109709 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9d0fc8ef-96e9-4e16-80d9-ed5a642f580f tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:42.110437 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9d0fc8ef-96e9-4e16-80d9-ed5a642f580f tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:42.111437 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9d0fc8ef-96e9-4e16-80d9-ed5a642f580f tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:42.111876 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9d0fc8ef-96e9-4e16-80d9-ed5a642f580f tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:42.186970 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-9feb09f3-5f14-481d-a8c1-6b2856236f74 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:42.196522 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-9feb09f3-5f14-481d-a8c1-6b2856236f74 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:42.198722 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-9feb09f3-5f14-481d-a8c1-6b2856236f74 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:42.213325 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-9feb09f3-5f14-481d-a8c1-6b2856236f74 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1731 microversion: 2.20 time: 0.256653 Oct 19 08:34:42.213325 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 717/1481] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:41 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1731 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:34:42.213325 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-5c0fe460-832e-4910-87a9-8a1af987a7c2 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:42.213325 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-5c0fe460-832e-4910-87a9-8a1af987a7c2 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 532d2be2-d6f6-4402-b37b-574a504d3ab4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:42.230390 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5c0fe460-832e-4910-87a9-8a1af987a7c2 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:42.230873 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5c0fe460-832e-4910-87a9-8a1af987a7c2 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:42.231775 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5c0fe460-832e-4910-87a9-8a1af987a7c2 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:42.232371 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5c0fe460-832e-4910-87a9-8a1af987a7c2 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:42.399912 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.network.security_group_api [None req-9d0fc8ef-96e9-4e16-80d9-ed5a642f580f tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Removing security group b94be8c3-234b-4cdf-8578-3672b7eda7b1 from port 5b3bdd50-50bd-4849-bb58-8d9b2a088787 Oct 19 08:34:42.556241 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-5c0fe460-832e-4910-87a9-8a1af987a7c2 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:42.563871 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-5c0fe460-832e-4910-87a9-8a1af987a7c2 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4" status: 200 len: 1277 microversion: 2.1 time: 0.361503 Oct 19 08:34:42.564440 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 718/1482] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:42 2021] GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4 => generated 1277 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:42.718097 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-995db669-e4b0-47b7-a851-47bd349d0d60 req-1422eb48-ea4b-4686-abd9-8a6b66a83fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "532d2be2-d6f6-4402-b37b-574a504d3ab4", "tag": "c2ff330e-a352-4142-beea-72ad324f3271"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:42.720236 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:34:42.720236 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:34:42.733304 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-995db669-e4b0-47b7-a851-47bd349d0d60 req-1422eb48-ea4b-4686-abd9-8a6b66a83fd2 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:42.734559 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-995db669-e4b0-47b7-a851-47bd349d0d60 req-1422eb48-ea4b-4686-abd9-8a6b66a83fd2 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:42.750240 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-995db669-e4b0-47b7-a851-47bd349d0d60 req-1422eb48-ea4b-4686-abd9-8a6b66a83fd2 service nova] Creating event network-changed:c2ff330e-a352-4142-beea-72ad324f3271 for instance 532d2be2-d6f6-4402-b37b-574a504d3ab4 on hv-cinder-81398 Oct 19 08:34:42.755936 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-995db669-e4b0-47b7-a851-47bd349d0d60 req-1422eb48-ea4b-4686-abd9-8a6b66a83fd2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043602 Oct 19 08:34:42.756782 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 719/1483] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:34:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 08:34:42.791856 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-3717f95e-fd52-4173-a113-54d01a0123fa tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:42.792597 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-3717f95e-fd52-4173-a113-54d01a0123fa tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:42.799535 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3717f95e-fd52-4173-a113-54d01a0123fa tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:42.800046 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3717f95e-fd52-4173-a113-54d01a0123fa tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:42.800898 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3717f95e-fd52-4173-a113-54d01a0123fa tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:42.801342 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3717f95e-fd52-4173-a113-54d01a0123fa tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:43.194437 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-9d0fc8ef-96e9-4e16-80d9-ed5a642f580f tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "POST /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991/action" status: 202 len: 0 microversion: 2.1 time: 1.096663 Oct 19 08:34:43.195714 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 765/1484] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 19 08:34:42 2021] POST /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991/action => generated 0 bytes in 1099 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:34:43.201020 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-77941e2e-21b7-496a-b739-743d70f46ba2 req-3915e23c-ad91-4369-894f-d81d79ca7be1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59c3fb17-9b00-4111-afa2-59ce69f7a986", "name": "network-vif-unplugged", "status": "completed", "tag": "12a0882c-425b-45ca-9a64-43ef73c77095"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:43.202965 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:34:43.202965 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:34:43.219153 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-77941e2e-21b7-496a-b739-743d70f46ba2 req-3915e23c-ad91-4369-894f-d81d79ca7be1 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:43.222546 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-77941e2e-21b7-496a-b739-743d70f46ba2 req-3915e23c-ad91-4369-894f-d81d79ca7be1 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:43.248535 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-3717f95e-fd52-4173-a113-54d01a0123fa tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:43.253681 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-77941e2e-21b7-496a-b739-743d70f46ba2 req-3915e23c-ad91-4369-894f-d81d79ca7be1 service nova] Creating event network-vif-unplugged:12a0882c-425b-45ca-9a64-43ef73c77095 for instance 59c3fb17-9b00-4111-afa2-59ce69f7a986 on hv-cinder-81398 Oct 19 08:34:43.260904 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-3717f95e-fd52-4173-a113-54d01a0123fa tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1520 microversion: 2.1 time: 0.472984 Oct 19 08:34:43.261514 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 720/1485] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:42 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1520 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:43.274315 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-77941e2e-21b7-496a-b739-743d70f46ba2 req-3915e23c-ad91-4369-894f-d81d79ca7be1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076503 Oct 19 08:34:43.275967 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 766/1486] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:34:43 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:34:43.280311 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-7f94e953-dc4f-4537-bc2a-d0aaca3ac0c3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:43.281738 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-7f94e953-dc4f-4537-bc2a-d0aaca3ac0c3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:43.288770 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7f94e953-dc4f-4537-bc2a-d0aaca3ac0c3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:43.289483 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7f94e953-dc4f-4537-bc2a-d0aaca3ac0c3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:43.290426 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7f94e953-dc4f-4537-bc2a-d0aaca3ac0c3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:43.291236 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-7f94e953-dc4f-4537-bc2a-d0aaca3ac0c3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:43.302422 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-67c7a2f7-8e46-4a5b-ab77-741ecefcf6da tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:43.307139 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-67c7a2f7-8e46-4a5b-ab77-741ecefcf6da tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:43.323891 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-67c7a2f7-8e46-4a5b-ab77-741ecefcf6da tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:43.324442 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-67c7a2f7-8e46-4a5b-ab77-741ecefcf6da tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:43.326328 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-67c7a2f7-8e46-4a5b-ab77-741ecefcf6da tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:43.329280 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-67c7a2f7-8e46-4a5b-ab77-741ecefcf6da tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:43.359304 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-7f94e953-dc4f-4537-bc2a-d0aaca3ac0c3 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084618 Oct 19 08:34:43.360506 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 721/1487] 10.222.0.26 () {58 vars in 1301 bytes} [Tue Oct 19 08:34:43 2021] GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:34:43.373476 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-6420785c-f50d-4c64-95f6-e682303078f7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:43.375653 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-6420785c-f50d-4c64-95f6-e682303078f7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:43.390953 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6420785c-f50d-4c64-95f6-e682303078f7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:43.391644 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6420785c-f50d-4c64-95f6-e682303078f7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:43.392716 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6420785c-f50d-4c64-95f6-e682303078f7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:43.393431 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6420785c-f50d-4c64-95f6-e682303078f7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:43.463426 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-6420785c-f50d-4c64-95f6-e682303078f7 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/os-volume_attachments/fcccfbc1-834c-4a80-b0f1-7e9c72410d37" status: 200 len: 194 microversion: 2.1 time: 0.095525 Oct 19 08:34:43.467471 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 722/1488] 10.222.0.26 () {58 vars in 1412 bytes} [Tue Oct 19 08:34:43 2021] GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/os-volume_attachments/fcccfbc1-834c-4a80-b0f1-7e9c72410d37 => generated 194 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:34:43.582835 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-dbe52927-afa4-4819-b96d-3a466f4ec9c9 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:43.584184 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-dbe52927-afa4-4819-b96d-3a466f4ec9c9 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 532d2be2-d6f6-4402-b37b-574a504d3ab4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:43.595630 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dbe52927-afa4-4819-b96d-3a466f4ec9c9 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:43.598735 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dbe52927-afa4-4819-b96d-3a466f4ec9c9 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:43.599909 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dbe52927-afa4-4819-b96d-3a466f4ec9c9 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:43.601544 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dbe52927-afa4-4819-b96d-3a466f4ec9c9 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:43.838338 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-67c7a2f7-8e46-4a5b-ab77-741ecefcf6da tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:43.868073 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-67c7a2f7-8e46-4a5b-ab77-741ecefcf6da tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:43.870568 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-67c7a2f7-8e46-4a5b-ab77-741ecefcf6da tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:43.871863 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-67c7a2f7-8e46-4a5b-ab77-741ecefcf6da tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1731 microversion: 2.20 time: 0.593960 Oct 19 08:34:43.883811 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 767/1489] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:43 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1731 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:34:44.049358 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-dbe52927-afa4-4819-b96d-3a466f4ec9c9 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:44.057748 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-dbe52927-afa4-4819-b96d-3a466f4ec9c9 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4" status: 200 len: 1277 microversion: 2.1 time: 0.480347 Oct 19 08:34:44.059230 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 723/1490] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:43 2021] GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4 => generated 1277 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:44.278656 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-51a655d3-2605-4028-a8c0-6e90d5371d49 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:44.279399 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-51a655d3-2605-4028-a8c0-6e90d5371d49 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:44.285861 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-51a655d3-2605-4028-a8c0-6e90d5371d49 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:44.286302 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-51a655d3-2605-4028-a8c0-6e90d5371d49 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:44.287287 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-51a655d3-2605-4028-a8c0-6e90d5371d49 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:44.287713 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-51a655d3-2605-4028-a8c0-6e90d5371d49 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:44.623208 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-520c832e-6bb2-4f34-b7ac-dc82daf445b7 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:44.623208 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-520c832e-6bb2-4f34-b7ac-dc82daf445b7 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:44.634789 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-520c832e-6bb2-4f34-b7ac-dc82daf445b7 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:44.635398 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-520c832e-6bb2-4f34-b7ac-dc82daf445b7 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:44.636681 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-520c832e-6bb2-4f34-b7ac-dc82daf445b7 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:44.637129 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-520c832e-6bb2-4f34-b7ac-dc82daf445b7 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:44.733210 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.objects.instance [None req-520c832e-6bb2-4f34-b7ac-dc82daf445b7 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lazy-loading 'services' on Instance uuid 7189072d-755e-4aa2-b182-d679f0abe991 {{(pid=114105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 19 08:34:44.817409 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-51a655d3-2605-4028-a8c0-6e90d5371d49 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:44.819808 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-520c832e-6bb2-4f34-b7ac-dc82daf445b7 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991/os-volume_attachments/bb605757-b4d3-4882-94f4-c33eb340204a" status: 202 len: 0 microversion: 2.1 time: 0.200707 Oct 19 08:34:44.824617 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 724/1491] 10.222.0.26 () {58 vars in 1415 bytes} [Tue Oct 19 08:34:44 2021] DELETE /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991/os-volume_attachments/bb605757-b4d3-4882-94f4-c33eb340204a => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:34:44.827582 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-51a655d3-2605-4028-a8c0-6e90d5371d49 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1576 microversion: 2.1 time: 0.552610 Oct 19 08:34:44.828751 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 768/1492] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:44 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1576 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:44.833040 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-c8bdbffb-f1af-4d07-b271-e40fe46ea49d req-fc9b1707-4cd3-4a86-9d41-172f7cd5a63c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7189072d-755e-4aa2-b182-d679f0abe991", "tag": "5b3bdd50-50bd-4849-bb58-8d9b2a088787"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:44.833918 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-720219b8-21dc-4699-8e26-9b7936285e81 req-778a0420-b003-428c-9c47-3a9823850aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7189072d-755e-4aa2-b182-d679f0abe991", "tag": "5b3bdd50-50bd-4849-bb58-8d9b2a088787"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:44.835025 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:34:44.835025 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:34:44.836203 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:34:44.836203 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:34:44.843828 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-c8bdbffb-f1af-4d07-b271-e40fe46ea49d req-fc9b1707-4cd3-4a86-9d41-172f7cd5a63c service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:44.844308 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-c8bdbffb-f1af-4d07-b271-e40fe46ea49d req-fc9b1707-4cd3-4a86-9d41-172f7cd5a63c service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:44.845011 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-720219b8-21dc-4699-8e26-9b7936285e81 req-778a0420-b003-428c-9c47-3a9823850aa8 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:44.845658 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-720219b8-21dc-4699-8e26-9b7936285e81 req-778a0420-b003-428c-9c47-3a9823850aa8 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:44.859039 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-c8bdbffb-f1af-4d07-b271-e40fe46ea49d req-fc9b1707-4cd3-4a86-9d41-172f7cd5a63c service nova] Creating event network-changed:5b3bdd50-50bd-4849-bb58-8d9b2a088787 for instance 7189072d-755e-4aa2-b182-d679f0abe991 on hv-cinder-81398 Oct 19 08:34:44.865747 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-c8bdbffb-f1af-4d07-b271-e40fe46ea49d req-fc9b1707-4cd3-4a86-9d41-172f7cd5a63c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038788 Oct 19 08:34:44.866827 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 725/1493] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:34:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:34:44.868991 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-720219b8-21dc-4699-8e26-9b7936285e81 req-778a0420-b003-428c-9c47-3a9823850aa8 service nova] Creating event network-changed:5b3bdd50-50bd-4849-bb58-8d9b2a088787 for instance 7189072d-755e-4aa2-b182-d679f0abe991 on hv-cinder-81398 Oct 19 08:34:44.872201 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-a884c92c-3b0a-4a5f-8a42-81761f7aa50a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:44.874149 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-a884c92c-3b0a-4a5f-8a42-81761f7aa50a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:44.880938 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a884c92c-3b0a-4a5f-8a42-81761f7aa50a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:44.881915 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a884c92c-3b0a-4a5f-8a42-81761f7aa50a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:44.883197 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a884c92c-3b0a-4a5f-8a42-81761f7aa50a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:44.883840 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a884c92c-3b0a-4a5f-8a42-81761f7aa50a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:44.897116 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-720219b8-21dc-4699-8e26-9b7936285e81 req-778a0420-b003-428c-9c47-3a9823850aa8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066335 Oct 19 08:34:44.898186 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 769/1494] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:34:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:34:44.907775 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a8228938-68ef-4bb0-917a-2302ed61060d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:44.908471 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a8228938-68ef-4bb0-917a-2302ed61060d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:44.917868 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a8228938-68ef-4bb0-917a-2302ed61060d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:44.920578 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a8228938-68ef-4bb0-917a-2302ed61060d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:44.921382 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a8228938-68ef-4bb0-917a-2302ed61060d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:44.921813 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a8228938-68ef-4bb0-917a-2302ed61060d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:44.926386 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-a884c92c-3b0a-4a5f-8a42-81761f7aa50a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057642 Oct 19 08:34:44.930670 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 726/1495] 10.222.0.26 () {58 vars in 1301 bytes} [Tue Oct 19 08:34:44 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:34:45.032907 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8bbb4753-dd57-48cc-acc7-4408af620c68 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f47d84c-1c63-444b-98d0-2e9107f9aefc"}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:45.034240 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-8bbb4753-dd57-48cc-acc7-4408af620c68 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:45.040625 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8bbb4753-dd57-48cc-acc7-4408af620c68 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:45.041197 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8bbb4753-dd57-48cc-acc7-4408af620c68 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:45.042058 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8bbb4753-dd57-48cc-acc7-4408af620c68 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:45.042613 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8bbb4753-dd57-48cc-acc7-4408af620c68 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:45.295140 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a8228938-68ef-4bb0-917a-2302ed61060d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:45.308617 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a8228938-68ef-4bb0-917a-2302ed61060d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:45.310362 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a8228938-68ef-4bb0-917a-2302ed61060d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:45.311656 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a8228938-68ef-4bb0-917a-2302ed61060d tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1718 microversion: 2.20 time: 0.411890 Oct 19 08:34:45.312487 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 770/1496] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:34:44 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1718 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:34:45.329867 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-8f07a9e5-52fe-417b-b71b-44380d1a1be9 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:45.330707 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-8f07a9e5-52fe-417b-b71b-44380d1a1be9 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 532d2be2-d6f6-4402-b37b-574a504d3ab4] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:45.340978 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8f07a9e5-52fe-417b-b71b-44380d1a1be9 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:45.342544 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8f07a9e5-52fe-417b-b71b-44380d1a1be9 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:45.343642 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8f07a9e5-52fe-417b-b71b-44380d1a1be9 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:45.344279 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-8f07a9e5-52fe-417b-b71b-44380d1a1be9 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:45.385247 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-8bbb4753-dd57-48cc-acc7-4408af620c68 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.356610 Oct 19 08:34:45.386543 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 727/1497] 10.222.0.26 () {60 vars in 1322 bytes} [Tue Oct 19 08:34:45 2021] POST /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/os-volume_attachments => generated 194 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:34:45.516586 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-8f07a9e5-52fe-417b-b71b-44380d1a1be9 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:45.525129 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-8f07a9e5-52fe-417b-b71b-44380d1a1be9 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4" status: 200 len: 1265 microversion: 2.1 time: 0.211935 Oct 19 08:34:45.525836 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 771/1498] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:45 2021] GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:45.845253 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-28f8bb61-c8ff-4612-b112-1860bd0ac0c5 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:45.845924 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-28f8bb61-c8ff-4612-b112-1860bd0ac0c5 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:45.872216 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-28f8bb61-c8ff-4612-b112-1860bd0ac0c5 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:45.873560 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-28f8bb61-c8ff-4612-b112-1860bd0ac0c5 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:45.874437 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-28f8bb61-c8ff-4612-b112-1860bd0ac0c5 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:45.874892 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-28f8bb61-c8ff-4612-b112-1860bd0ac0c5 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:45.938596 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-86fd0018-cb82-4b68-aa2a-e325b5f71a9a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:45.939580 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-86fd0018-cb82-4b68-aa2a-e325b5f71a9a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:45.945770 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-86fd0018-cb82-4b68-aa2a-e325b5f71a9a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:45.946207 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-86fd0018-cb82-4b68-aa2a-e325b5f71a9a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:45.949663 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-86fd0018-cb82-4b68-aa2a-e325b5f71a9a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:45.949925 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-86fd0018-cb82-4b68-aa2a-e325b5f71a9a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:45.993296 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-86fd0018-cb82-4b68-aa2a-e325b5f71a9a tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059447 Oct 19 08:34:45.994463 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 772/1499] 10.222.0.26 () {58 vars in 1301 bytes} [Tue Oct 19 08:34:45 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 08:34:46.007004 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-4bbd1497-ae81-4287-9ae0-80417c75f514 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:46.008048 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-4bbd1497-ae81-4287-9ae0-80417c75f514 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:46.016399 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4bbd1497-ae81-4287-9ae0-80417c75f514 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:46.018229 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4bbd1497-ae81-4287-9ae0-80417c75f514 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:46.019775 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4bbd1497-ae81-4287-9ae0-80417c75f514 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:46.020506 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4bbd1497-ae81-4287-9ae0-80417c75f514 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:46.028148 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-28f8bb61-c8ff-4612-b112-1860bd0ac0c5 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:46.036121 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-28f8bb61-c8ff-4612-b112-1860bd0ac0c5 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1576 microversion: 2.1 time: 0.195320 Oct 19 08:34:46.036704 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 728/1500] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:45 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1576 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:46.112153 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.wsgi [None req-4bbd1497-ae81-4287-9ae0-80417c75f514 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] HTTP exception thrown: Instance 7189072d-755e-4aa2-b182-d679f0abe991 is not attached to volume bb605757-b4d3-4882-94f4-c33eb340204a Oct 19 08:34:46.117765 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-4bbd1497-ae81-4287-9ae0-80417c75f514 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Returning 404 to user: Instance 7189072d-755e-4aa2-b182-d679f0abe991 is not attached to volume bb605757-b4d3-4882-94f4-c33eb340204a {{(pid=114106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:34:46.120094 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-4bbd1497-ae81-4287-9ae0-80417c75f514 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991/os-volume_attachments/bb605757-b4d3-4882-94f4-c33eb340204a" status: 404 len: 154 microversion: 2.1 time: 0.118282 Oct 19 08:34:46.120603 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 773/1501] 10.222.0.26 () {58 vars in 1415 bytes} [Tue Oct 19 08:34:45 2021] DELETE /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991/os-volume_attachments/bb605757-b4d3-4882-94f4-c33eb340204a => generated 154 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 08:34:46.542465 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-653f3703-cc21-4ae0-8fd2-b4cb6c0dc83e tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:46.543087 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-653f3703-cc21-4ae0-8fd2-b4cb6c0dc83e tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 532d2be2-d6f6-4402-b37b-574a504d3ab4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:46.549939 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-653f3703-cc21-4ae0-8fd2-b4cb6c0dc83e tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:46.550383 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-653f3703-cc21-4ae0-8fd2-b4cb6c0dc83e tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:46.551162 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-653f3703-cc21-4ae0-8fd2-b4cb6c0dc83e tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:46.551589 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-653f3703-cc21-4ae0-8fd2-b4cb6c0dc83e tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:46.672814 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-653f3703-cc21-4ae0-8fd2-b4cb6c0dc83e tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:46.680056 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-653f3703-cc21-4ae0-8fd2-b4cb6c0dc83e tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4" status: 200 len: 1265 microversion: 2.1 time: 0.141206 Oct 19 08:34:46.680608 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 729/1502] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:46 2021] GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4 => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:47.052792 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-90d8775d-d1b7-4a55-9e61-2cdbb1f030c4 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:47.053421 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-90d8775d-d1b7-4a55-9e61-2cdbb1f030c4 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:47.059180 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-90d8775d-d1b7-4a55-9e61-2cdbb1f030c4 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:47.059621 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-90d8775d-d1b7-4a55-9e61-2cdbb1f030c4 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:47.060879 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-90d8775d-d1b7-4a55-9e61-2cdbb1f030c4 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:47.061302 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-90d8775d-d1b7-4a55-9e61-2cdbb1f030c4 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:47.179779 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-90d8775d-d1b7-4a55-9e61-2cdbb1f030c4 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:47.187204 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-90d8775d-d1b7-4a55-9e61-2cdbb1f030c4 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1576 microversion: 2.1 time: 0.138040 Oct 19 08:34:47.187765 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 774/1503] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:47 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1576 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:47.257622 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-26cf3e6b-1871-40b1-973e-bbee25749cd1 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:47.258106 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-26cf3e6b-1871-40b1-973e-bbee25749cd1 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:47.264941 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-26cf3e6b-1871-40b1-973e-bbee25749cd1 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:47.265388 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-26cf3e6b-1871-40b1-973e-bbee25749cd1 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:47.266160 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-26cf3e6b-1871-40b1-973e-bbee25749cd1 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:47.266633 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-26cf3e6b-1871-40b1-973e-bbee25749cd1 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:47.290770 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-26cf3e6b-1871-40b1-973e-bbee25749cd1 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Going to try to terminate instance {{(pid=114105) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 19 08:34:47.364274 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-26cf3e6b-1871-40b1-973e-bbee25749cd1 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 204 len: 0 microversion: 2.1 time: 0.109945 Oct 19 08:34:47.365049 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 730/1504] 10.222.0.26 () {58 vars in 1238 bytes} [Tue Oct 19 08:34:47 2021] DELETE /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 08:34:47.373163 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-f68046fc-fb59-431f-9246-43b7bef8adb5 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:47.373868 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-f68046fc-fb59-431f-9246-43b7bef8adb5 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:47.379769 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f68046fc-fb59-431f-9246-43b7bef8adb5 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:47.380214 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f68046fc-fb59-431f-9246-43b7bef8adb5 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:47.380983 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f68046fc-fb59-431f-9246-43b7bef8adb5 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:47.381410 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f68046fc-fb59-431f-9246-43b7bef8adb5 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:47.506767 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-f68046fc-fb59-431f-9246-43b7bef8adb5 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:47.515795 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-f68046fc-fb59-431f-9246-43b7bef8adb5 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1555 microversion: 2.1 time: 0.146527 Oct 19 08:34:47.516350 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 775/1505] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:47 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1555 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:47.697409 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-ef963595-198e-49a2-a15b-02033c09d074 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:47.698110 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-ef963595-198e-49a2-a15b-02033c09d074 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 532d2be2-d6f6-4402-b37b-574a504d3ab4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:47.705500 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ef963595-198e-49a2-a15b-02033c09d074 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:47.705704 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ef963595-198e-49a2-a15b-02033c09d074 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:47.706633 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ef963595-198e-49a2-a15b-02033c09d074 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:47.707059 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-ef963595-198e-49a2-a15b-02033c09d074 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:47.831052 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-ef963595-198e-49a2-a15b-02033c09d074 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:47.839433 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-ef963595-198e-49a2-a15b-02033c09d074 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4" status: 200 len: 1265 microversion: 2.1 time: 0.145755 Oct 19 08:34:47.840121 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 731/1506] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:47 2021] GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:48.204512 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c1f06af1-0e5b-4d95-9832-b8984572174f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:48.205045 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c1f06af1-0e5b-4d95-9832-b8984572174f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:48.210986 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c1f06af1-0e5b-4d95-9832-b8984572174f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:48.211430 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c1f06af1-0e5b-4d95-9832-b8984572174f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:48.212184 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c1f06af1-0e5b-4d95-9832-b8984572174f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:48.212611 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c1f06af1-0e5b-4d95-9832-b8984572174f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:48.331339 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-c1f06af1-0e5b-4d95-9832-b8984572174f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:48.338638 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c1f06af1-0e5b-4d95-9832-b8984572174f tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1576 microversion: 2.1 time: 0.137904 Oct 19 08:34:48.339197 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 776/1507] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:48 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1576 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:48.532891 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-054fdfc0-1d49-404a-b3b8-44a324c30c1d tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:48.533420 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-054fdfc0-1d49-404a-b3b8-44a324c30c1d tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:48.539316 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-054fdfc0-1d49-404a-b3b8-44a324c30c1d tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:48.540484 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-054fdfc0-1d49-404a-b3b8-44a324c30c1d tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:48.540484 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-054fdfc0-1d49-404a-b3b8-44a324c30c1d tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:48.540917 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-054fdfc0-1d49-404a-b3b8-44a324c30c1d tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:48.663725 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-054fdfc0-1d49-404a-b3b8-44a324c30c1d tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:48.671423 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-054fdfc0-1d49-404a-b3b8-44a324c30c1d tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1555 microversion: 2.1 time: 0.142330 Oct 19 08:34:48.671976 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 732/1508] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:48 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1555 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:48.856228 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-cdc3e98b-7879-4cce-bcf7-90f3caec35cb tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:48.857325 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-cdc3e98b-7879-4cce-bcf7-90f3caec35cb tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 532d2be2-d6f6-4402-b37b-574a504d3ab4] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:48.863195 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cdc3e98b-7879-4cce-bcf7-90f3caec35cb tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:48.863651 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cdc3e98b-7879-4cce-bcf7-90f3caec35cb tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:48.864395 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cdc3e98b-7879-4cce-bcf7-90f3caec35cb tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:48.864820 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-cdc3e98b-7879-4cce-bcf7-90f3caec35cb tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:48.984435 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-cdc3e98b-7879-4cce-bcf7-90f3caec35cb tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:48.991586 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-cdc3e98b-7879-4cce-bcf7-90f3caec35cb tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4" status: 200 len: 1265 microversion: 2.1 time: 0.138999 Oct 19 08:34:48.992141 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 777/1509] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:48 2021] GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4 => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:49.356278 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-32dce94a-901e-417f-a974-00489c3f05e6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:49.356906 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-32dce94a-901e-417f-a974-00489c3f05e6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:49.362619 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-32dce94a-901e-417f-a974-00489c3f05e6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:49.363061 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-32dce94a-901e-417f-a974-00489c3f05e6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:49.363813 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-32dce94a-901e-417f-a974-00489c3f05e6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:49.364238 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-32dce94a-901e-417f-a974-00489c3f05e6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:49.481297 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-32dce94a-901e-417f-a974-00489c3f05e6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:49.488457 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-32dce94a-901e-417f-a974-00489c3f05e6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1576 microversion: 2.1 time: 0.135802 Oct 19 08:34:49.489013 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 733/1510] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:49 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1576 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:49.687390 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-18c693c3-0aba-4624-bbee-f122a9c8a871 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:49.687995 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-18c693c3-0aba-4624-bbee-f122a9c8a871 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:49.693691 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-18c693c3-0aba-4624-bbee-f122a9c8a871 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:49.694135 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-18c693c3-0aba-4624-bbee-f122a9c8a871 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:49.694938 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-18c693c3-0aba-4624-bbee-f122a9c8a871 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:49.695368 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-18c693c3-0aba-4624-bbee-f122a9c8a871 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:49.819136 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-18c693c3-0aba-4624-bbee-f122a9c8a871 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd530762e3bbd4a2cad4a0002c7d52a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd22145dede44acfb6409d55f4c00fcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:49.827206 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-18c693c3-0aba-4624-bbee-f122a9c8a871 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 200 len: 1555 microversion: 2.1 time: 0.143458 Oct 19 08:34:49.828077 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 778/1511] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:49 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 1555 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:50.009133 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d5171c88-14fc-45e4-a6a1-f3cc9785599e tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:50.009832 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-d5171c88-14fc-45e4-a6a1-f3cc9785599e tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 532d2be2-d6f6-4402-b37b-574a504d3ab4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:50.016986 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d5171c88-14fc-45e4-a6a1-f3cc9785599e tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:50.017654 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d5171c88-14fc-45e4-a6a1-f3cc9785599e tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:50.018666 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d5171c88-14fc-45e4-a6a1-f3cc9785599e tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:50.019156 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d5171c88-14fc-45e4-a6a1-f3cc9785599e tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:50.131388 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-6604f53b-58d0-438d-8df6-077bb2298ffe req-d500c27e-a723-48fb-ba16-c1dad8df18c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7189072d-755e-4aa2-b182-d679f0abe991", "name": "network-vif-deleted", "tag": "5b3bdd50-50bd-4849-bb58-8d9b2a088787"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:50.132900 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:34:50.132900 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:34:50.140554 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-6604f53b-58d0-438d-8df6-077bb2298ffe req-d500c27e-a723-48fb-ba16-c1dad8df18c3 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:50.141186 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-6604f53b-58d0-438d-8df6-077bb2298ffe req-d500c27e-a723-48fb-ba16-c1dad8df18c3 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:50.152586 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-6604f53b-58d0-438d-8df6-077bb2298ffe req-d500c27e-a723-48fb-ba16-c1dad8df18c3 service nova] Creating event network-vif-deleted:5b3bdd50-50bd-4849-bb58-8d9b2a088787 for instance 7189072d-755e-4aa2-b182-d679f0abe991 on hv-cinder-81398 Oct 19 08:34:50.158483 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-6604f53b-58d0-438d-8df6-077bb2298ffe req-d500c27e-a723-48fb-ba16-c1dad8df18c3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031241 Oct 19 08:34:50.159103 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 779/1512] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:34:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:34:50.159563 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-d5171c88-14fc-45e4-a6a1-f3cc9785599e tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:50.170098 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-d5171c88-14fc-45e4-a6a1-f3cc9785599e tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4" status: 200 len: 1265 microversion: 2.1 time: 0.164248 Oct 19 08:34:50.170682 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 734/1513] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:50 2021] GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:50.505600 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-811434ff-30df-4aac-bfb5-584cacfb495e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:50.506295 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-811434ff-30df-4aac-bfb5-584cacfb495e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:50.512714 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-811434ff-30df-4aac-bfb5-584cacfb495e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:50.513825 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-811434ff-30df-4aac-bfb5-584cacfb495e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:50.515011 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-811434ff-30df-4aac-bfb5-584cacfb495e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:50.515434 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-811434ff-30df-4aac-bfb5-584cacfb495e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:50.638684 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-811434ff-30df-4aac-bfb5-584cacfb495e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:50.646578 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-811434ff-30df-4aac-bfb5-584cacfb495e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1576 microversion: 2.1 time: 0.144955 Oct 19 08:34:50.647102 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 780/1514] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:50 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1576 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:50.843975 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-206c19dd-6f58-487e-91a3-bc2ca1e9d961 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:50.844567 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-206c19dd-6f58-487e-91a3-bc2ca1e9d961 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] [instance: 7189072d-755e-4aa2-b182-d679f0abe991] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:50.850315 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-206c19dd-6f58-487e-91a3-bc2ca1e9d961 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:50.850816 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-206c19dd-6f58-487e-91a3-bc2ca1e9d961 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:50.851548 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-206c19dd-6f58-487e-91a3-bc2ca1e9d961 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:50.851977 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-206c19dd-6f58-487e-91a3-bc2ca1e9d961 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:50.865506 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.wsgi [None req-206c19dd-6f58-487e-91a3-bc2ca1e9d961 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] HTTP exception thrown: Instance 7189072d-755e-4aa2-b182-d679f0abe991 could not be found. Oct 19 08:34:50.866075 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-206c19dd-6f58-487e-91a3-bc2ca1e9d961 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Returning 404 to user: Instance 7189072d-755e-4aa2-b182-d679f0abe991 could not be found. {{(pid=114105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:34:50.866892 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-206c19dd-6f58-487e-91a3-bc2ca1e9d961 tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991" status: 404 len: 111 microversion: 2.1 time: 0.026692 Oct 19 08:34:50.867397 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 735/1515] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:50 2021] GET /compute/v2.1/servers/7189072d-755e-4aa2-b182-d679f0abe991 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:34:50.875973 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-5310e89b-f452-419c-8266-9d3647100f6d tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] Calling method '.version_select at 0x7fcaddd949d0>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:50.893501 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-5310e89b-f452-419c-8266-9d3647100f6d tempest-TestMinimumBasicScenario-506711207 tempest-TestMinimumBasicScenario-506711207-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1588346439" status: 202 len: 0 microversion: 2.1 time: 0.021752 Oct 19 08:34:50.893971 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 781/1516] 10.222.0.26 () {58 vars in 1271 bytes} [Tue Oct 19 08:34:50 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1588346439 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:34:51.187662 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-371ff2fc-0c47-4694-9331-5e1f7f32f84b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:51.188403 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-371ff2fc-0c47-4694-9331-5e1f7f32f84b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 532d2be2-d6f6-4402-b37b-574a504d3ab4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:51.194589 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-371ff2fc-0c47-4694-9331-5e1f7f32f84b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:51.195040 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-371ff2fc-0c47-4694-9331-5e1f7f32f84b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:51.195811 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-371ff2fc-0c47-4694-9331-5e1f7f32f84b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:51.196243 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-371ff2fc-0c47-4694-9331-5e1f7f32f84b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:51.324226 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-371ff2fc-0c47-4694-9331-5e1f7f32f84b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:51.332848 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-371ff2fc-0c47-4694-9331-5e1f7f32f84b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4" status: 200 len: 1265 microversion: 2.1 time: 0.149909 Oct 19 08:34:51.333399 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 736/1517] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:51 2021] GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:51.664849 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-4e9c552c-7a06-41d6-9ee4-05598b5550aa tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:51.665363 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-4e9c552c-7a06-41d6-9ee4-05598b5550aa tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:51.671151 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4e9c552c-7a06-41d6-9ee4-05598b5550aa tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:51.671593 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4e9c552c-7a06-41d6-9ee4-05598b5550aa tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:51.672356 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4e9c552c-7a06-41d6-9ee4-05598b5550aa tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:51.672780 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4e9c552c-7a06-41d6-9ee4-05598b5550aa tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:51.795615 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-4e9c552c-7a06-41d6-9ee4-05598b5550aa tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:51.803119 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-4e9c552c-7a06-41d6-9ee4-05598b5550aa tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1576 microversion: 2.1 time: 0.142154 Oct 19 08:34:51.803673 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 782/1518] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:51 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1576 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:52.349204 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-0a759203-fce9-4d22-a3ba-e114b15711f3 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:52.350592 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-0a759203-fce9-4d22-a3ba-e114b15711f3 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 532d2be2-d6f6-4402-b37b-574a504d3ab4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:52.357807 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0a759203-fce9-4d22-a3ba-e114b15711f3 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:52.359061 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0a759203-fce9-4d22-a3ba-e114b15711f3 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:52.360294 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0a759203-fce9-4d22-a3ba-e114b15711f3 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:52.361461 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0a759203-fce9-4d22-a3ba-e114b15711f3 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:52.492409 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-0a759203-fce9-4d22-a3ba-e114b15711f3 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:52.500972 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-0a759203-fce9-4d22-a3ba-e114b15711f3 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4" status: 200 len: 1265 microversion: 2.1 time: 0.155460 Oct 19 08:34:52.501513 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 737/1519] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:52 2021] GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:52.820480 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a8be0ccf-a6ec-46af-a933-d5357141f4d3 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:52.821083 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a8be0ccf-a6ec-46af-a933-d5357141f4d3 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:52.835248 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a8be0ccf-a6ec-46af-a933-d5357141f4d3 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:52.836103 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a8be0ccf-a6ec-46af-a933-d5357141f4d3 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:52.838919 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a8be0ccf-a6ec-46af-a933-d5357141f4d3 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:52.839754 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a8be0ccf-a6ec-46af-a933-d5357141f4d3 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:53.075009 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a8be0ccf-a6ec-46af-a933-d5357141f4d3 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:53.083312 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a8be0ccf-a6ec-46af-a933-d5357141f4d3 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1576 microversion: 2.1 time: 0.266872 Oct 19 08:34:53.084274 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 783/1520] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:52 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1576 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:53.517465 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-80c388a7-e697-4585-a33d-a806771cfce4 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:53.518073 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-80c388a7-e697-4585-a33d-a806771cfce4 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 532d2be2-d6f6-4402-b37b-574a504d3ab4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:53.524529 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-80c388a7-e697-4585-a33d-a806771cfce4 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:53.524980 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-80c388a7-e697-4585-a33d-a806771cfce4 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:53.525757 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-80c388a7-e697-4585-a33d-a806771cfce4 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:53.526187 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-80c388a7-e697-4585-a33d-a806771cfce4 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:53.764999 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-80c388a7-e697-4585-a33d-a806771cfce4 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:53.772835 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-80c388a7-e697-4585-a33d-a806771cfce4 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4" status: 200 len: 1265 microversion: 2.1 time: 0.259503 Oct 19 08:34:53.773418 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 738/1521] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:53 2021] GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4 => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:53.977620 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e9c62a38-b3f2-44bd-86bb-f8faa58240e9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:53.978551 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e9c62a38-b3f2-44bd-86bb-f8faa58240e9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:53.985600 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e9c62a38-b3f2-44bd-86bb-f8faa58240e9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:53.986038 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e9c62a38-b3f2-44bd-86bb-f8faa58240e9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:53.986823 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e9c62a38-b3f2-44bd-86bb-f8faa58240e9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:53.987242 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e9c62a38-b3f2-44bd-86bb-f8faa58240e9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:54.018251 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e9c62a38-b3f2-44bd-86bb-f8faa58240e9 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044652 Oct 19 08:34:54.018838 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 784/1522] 10.222.0.26 () {58 vars in 1301 bytes} [Tue Oct 19 08:34:53 2021] GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:34:54.100886 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-78681eaf-9539-4797-89b3-8a17672b75a7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:54.101493 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-78681eaf-9539-4797-89b3-8a17672b75a7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:54.107294 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-78681eaf-9539-4797-89b3-8a17672b75a7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:54.107746 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-78681eaf-9539-4797-89b3-8a17672b75a7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:54.109008 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-78681eaf-9539-4797-89b3-8a17672b75a7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:54.109441 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-78681eaf-9539-4797-89b3-8a17672b75a7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:54.232105 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-78681eaf-9539-4797-89b3-8a17672b75a7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:54.245970 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-78681eaf-9539-4797-89b3-8a17672b75a7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1576 microversion: 2.1 time: 0.148247 Oct 19 08:34:54.251338 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 739/1523] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:54 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:54.475107 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-abcc7c13-19ad-42a1-9fe7-5952ba19814b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:54.475603 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-abcc7c13-19ad-42a1-9fe7-5952ba19814b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:54.481549 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-abcc7c13-19ad-42a1-9fe7-5952ba19814b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:54.481988 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-abcc7c13-19ad-42a1-9fe7-5952ba19814b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:54.488638 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-abcc7c13-19ad-42a1-9fe7-5952ba19814b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:54.489385 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-abcc7c13-19ad-42a1-9fe7-5952ba19814b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:54.522282 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-abcc7c13-19ad-42a1-9fe7-5952ba19814b tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/os-volume_attachments/fcccfbc1-834c-4a80-b0f1-7e9c72410d37" status: 200 len: 194 microversion: 2.1 time: 0.050939 Oct 19 08:34:54.522920 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 785/1524] 10.222.0.26 () {58 vars in 1412 bytes} [Tue Oct 19 08:34:54 2021] GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/os-volume_attachments/fcccfbc1-834c-4a80-b0f1-7e9c72410d37 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:34:54.533034 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-188581db-208c-4572-98d7-2630c2de6e93 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:54.533801 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-188581db-208c-4572-98d7-2630c2de6e93 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:54.540154 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-188581db-208c-4572-98d7-2630c2de6e93 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:54.540940 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-188581db-208c-4572-98d7-2630c2de6e93 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:54.542027 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-188581db-208c-4572-98d7-2630c2de6e93 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:54.542706 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-188581db-208c-4572-98d7-2630c2de6e93 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:54.648688 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.objects.instance [None req-188581db-208c-4572-98d7-2630c2de6e93 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lazy-loading 'services' on Instance uuid 8da1c23b-61b7-480c-b3b4-90f5793c0f55 {{(pid=114105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 19 08:34:54.728288 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-188581db-208c-4572-98d7-2630c2de6e93 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/os-volume_attachments/fcccfbc1-834c-4a80-b0f1-7e9c72410d37" status: 202 len: 0 microversion: 2.1 time: 0.199412 Oct 19 08:34:54.729126 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 740/1525] 10.222.0.26 () {58 vars in 1415 bytes} [Tue Oct 19 08:34:54 2021] DELETE /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/os-volume_attachments/fcccfbc1-834c-4a80-b0f1-7e9c72410d37 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:34:54.789422 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c124871d-fb65-440e-96f4-ac86b0511c96 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:54.790273 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c124871d-fb65-440e-96f4-ac86b0511c96 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 532d2be2-d6f6-4402-b37b-574a504d3ab4] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:54.797982 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c124871d-fb65-440e-96f4-ac86b0511c96 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:54.798704 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c124871d-fb65-440e-96f4-ac86b0511c96 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:54.799824 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c124871d-fb65-440e-96f4-ac86b0511c96 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:54.800503 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c124871d-fb65-440e-96f4-ac86b0511c96 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:54.999161 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-c124871d-fb65-440e-96f4-ac86b0511c96 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:55.007911 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c124871d-fb65-440e-96f4-ac86b0511c96 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4" status: 200 len: 1265 microversion: 2.1 time: 0.222412 Oct 19 08:34:55.010739 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 786/1526] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:54 2021] GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4 => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:55.204016 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-347fc60b-50e5-4c84-b913-d9f4089bf6c5 req-c8851d86-cc66-42bf-8b2c-ba560e42e378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "532d2be2-d6f6-4402-b37b-574a504d3ab4", "name": "network-vif-plugged", "status": "completed", "tag": "c2ff330e-a352-4142-beea-72ad324f3271"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:55.206079 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:34:55.206079 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:34:55.214415 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-347fc60b-50e5-4c84-b913-d9f4089bf6c5 req-c8851d86-cc66-42bf-8b2c-ba560e42e378 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:55.214866 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-347fc60b-50e5-4c84-b913-d9f4089bf6c5 req-c8851d86-cc66-42bf-8b2c-ba560e42e378 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:55.226593 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-347fc60b-50e5-4c84-b913-d9f4089bf6c5 req-c8851d86-cc66-42bf-8b2c-ba560e42e378 service nova] Creating event network-vif-plugged:c2ff330e-a352-4142-beea-72ad324f3271 for instance 532d2be2-d6f6-4402-b37b-574a504d3ab4 on hv-cinder-81398 Oct 19 08:34:55.231616 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-347fc60b-50e5-4c84-b913-d9f4089bf6c5 req-c8851d86-cc66-42bf-8b2c-ba560e42e378 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032828 Oct 19 08:34:55.232401 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 741/1527] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:34:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:34:55.262939 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-5669bc5d-c04e-4443-878c-f1019e604007 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:55.263541 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-5669bc5d-c04e-4443-878c-f1019e604007 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:55.272483 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5669bc5d-c04e-4443-878c-f1019e604007 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:55.273129 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5669bc5d-c04e-4443-878c-f1019e604007 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:55.274196 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5669bc5d-c04e-4443-878c-f1019e604007 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:55.274649 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5669bc5d-c04e-4443-878c-f1019e604007 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:55.417954 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-5669bc5d-c04e-4443-878c-f1019e604007 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:55.428622 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-5669bc5d-c04e-4443-878c-f1019e604007 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1576 microversion: 2.1 time: 0.169262 Oct 19 08:34:55.429501 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 787/1528] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:55 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:56.026308 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-eb36f484-5ce9-4c13-898c-851385b54e48 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:56.027203 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-eb36f484-5ce9-4c13-898c-851385b54e48 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 532d2be2-d6f6-4402-b37b-574a504d3ab4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:56.035010 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-eb36f484-5ce9-4c13-898c-851385b54e48 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:56.035593 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-eb36f484-5ce9-4c13-898c-851385b54e48 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:56.036601 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-eb36f484-5ce9-4c13-898c-851385b54e48 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:56.037103 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-eb36f484-5ce9-4c13-898c-851385b54e48 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:56.198208 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-eb36f484-5ce9-4c13-898c-851385b54e48 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:56.206027 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-eb36f484-5ce9-4c13-898c-851385b54e48 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4" status: 200 len: 1265 microversion: 2.1 time: 0.183846 Oct 19 08:34:56.206626 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 742/1529] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:56 2021] GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:56.447557 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-a7f4503f-0806-43fd-887b-fc8052c93d83 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:56.448363 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-a7f4503f-0806-43fd-887b-fc8052c93d83 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:56.455125 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a7f4503f-0806-43fd-887b-fc8052c93d83 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:56.455771 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a7f4503f-0806-43fd-887b-fc8052c93d83 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:56.461393 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a7f4503f-0806-43fd-887b-fc8052c93d83 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:56.461959 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-a7f4503f-0806-43fd-887b-fc8052c93d83 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:56.912502 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-562542da-f182-4681-a2dd-b7a2e0f9ba72 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:56.913069 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-562542da-f182-4681-a2dd-b7a2e0f9ba72 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:56.919051 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-562542da-f182-4681-a2dd-b7a2e0f9ba72 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:56.919491 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-562542da-f182-4681-a2dd-b7a2e0f9ba72 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:56.920266 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-562542da-f182-4681-a2dd-b7a2e0f9ba72 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:56.921236 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-562542da-f182-4681-a2dd-b7a2e0f9ba72 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:56.952758 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-562542da-f182-4681-a2dd-b7a2e0f9ba72 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/os-volume_attachments/3f47d84c-1c63-444b-98d0-2e9107f9aefc" status: 200 len: 194 microversion: 2.1 time: 0.043959 Oct 19 08:34:56.953526 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 743/1530] 10.222.0.26 () {58 vars in 1412 bytes} [Tue Oct 19 08:34:56 2021] GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/os-volume_attachments/3f47d84c-1c63-444b-98d0-2e9107f9aefc => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 08:34:56.963051 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-96961846-3237-4486-8f11-425ed3fdf049 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:56.963804 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-96961846-3237-4486-8f11-425ed3fdf049 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:56.967492 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-a7f4503f-0806-43fd-887b-fc8052c93d83 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:56.972820 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-96961846-3237-4486-8f11-425ed3fdf049 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:56.973281 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-96961846-3237-4486-8f11-425ed3fdf049 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:56.974052 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-96961846-3237-4486-8f11-425ed3fdf049 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:56.974479 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-96961846-3237-4486-8f11-425ed3fdf049 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:56.975698 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-a7f4503f-0806-43fd-887b-fc8052c93d83 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1576 microversion: 2.1 time: 0.532966 Oct 19 08:34:56.976379 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 788/1531] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:56 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1576 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:57.069206 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.objects.instance [None req-96961846-3237-4486-8f11-425ed3fdf049 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lazy-loading 'services' on Instance uuid 8da1c23b-61b7-480c-b3b4-90f5793c0f55 {{(pid=114105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 19 08:34:57.189784 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-96961846-3237-4486-8f11-425ed3fdf049 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/os-volume_attachments/3f47d84c-1c63-444b-98d0-2e9107f9aefc" status: 202 len: 0 microversion: 2.1 time: 0.229861 Oct 19 08:34:57.194292 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 744/1532] 10.222.0.26 () {58 vars in 1415 bytes} [Tue Oct 19 08:34:56 2021] DELETE /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/os-volume_attachments/3f47d84c-1c63-444b-98d0-2e9107f9aefc => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:34:57.224048 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-4f761f7d-903d-4862-a12d-bac7f5a9ef56 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:57.225031 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-4f761f7d-903d-4862-a12d-bac7f5a9ef56 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 532d2be2-d6f6-4402-b37b-574a504d3ab4] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:57.231497 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4f761f7d-903d-4862-a12d-bac7f5a9ef56 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:57.231941 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4f761f7d-903d-4862-a12d-bac7f5a9ef56 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:57.232707 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4f761f7d-903d-4862-a12d-bac7f5a9ef56 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:57.233856 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-4f761f7d-903d-4862-a12d-bac7f5a9ef56 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:57.469105 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-4f761f7d-903d-4862-a12d-bac7f5a9ef56 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:57.476593 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-4f761f7d-903d-4862-a12d-bac7f5a9ef56 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4" status: 200 len: 1452 microversion: 2.1 time: 0.257155 Oct 19 08:34:57.477170 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 789/1533] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:57 2021] GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4 => generated 1452 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:57.497143 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d4cc4ebb-4512-4cda-bb3a-d11f4d62d665 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:57.497832 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-d4cc4ebb-4512-4cda-bb3a-d11f4d62d665 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 532d2be2-d6f6-4402-b37b-574a504d3ab4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:57.503908 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d4cc4ebb-4512-4cda-bb3a-d11f4d62d665 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:57.504356 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d4cc4ebb-4512-4cda-bb3a-d11f4d62d665 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:57.505120 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d4cc4ebb-4512-4cda-bb3a-d11f4d62d665 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:57.505632 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d4cc4ebb-4512-4cda-bb3a-d11f4d62d665 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:57.812414 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-d4cc4ebb-4512-4cda-bb3a-d11f4d62d665 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:57.820718 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-d4cc4ebb-4512-4cda-bb3a-d11f4d62d665 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4" status: 200 len: 1452 microversion: 2.1 time: 0.327558 Oct 19 08:34:57.834126 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 745/1534] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:57 2021] GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4 => generated 1452 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:57.992988 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-2ea36721-6272-4e2c-af68-155a3eb3a16e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:57.993559 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-2ea36721-6272-4e2c-af68-155a3eb3a16e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:58.011622 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2ea36721-6272-4e2c-af68-155a3eb3a16e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:58.015445 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2ea36721-6272-4e2c-af68-155a3eb3a16e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:58.016640 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2ea36721-6272-4e2c-af68-155a3eb3a16e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:58.017438 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2ea36721-6272-4e2c-af68-155a3eb3a16e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:58.265736 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-2ea36721-6272-4e2c-af68-155a3eb3a16e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:58.276228 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-2ea36721-6272-4e2c-af68-155a3eb3a16e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1576 microversion: 2.1 time: 0.286771 Oct 19 08:34:58.278205 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 790/1535] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:57 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1576 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:34:58.417448 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-a66bf23a-c3f1-4d52-9fc7-1319a1d174ae tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:58.418907 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-a66bf23a-c3f1-4d52-9fc7-1319a1d174ae tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:58.427586 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a66bf23a-c3f1-4d52-9fc7-1319a1d174ae tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:58.428690 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a66bf23a-c3f1-4d52-9fc7-1319a1d174ae tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:58.430042 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a66bf23a-c3f1-4d52-9fc7-1319a1d174ae tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:58.430042 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a66bf23a-c3f1-4d52-9fc7-1319a1d174ae tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:58.463209 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-a66bf23a-c3f1-4d52-9fc7-1319a1d174ae tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049553 Oct 19 08:34:58.464162 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 746/1536] 10.222.0.26 () {58 vars in 1301 bytes} [Tue Oct 19 08:34:58 2021] GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 08:34:58.594829 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-83c1c710-1394-41ab-b82b-a7c95f9045cf tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:58.595880 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-83c1c710-1394-41ab-b82b-a7c95f9045cf tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:58.609198 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-83c1c710-1394-41ab-b82b-a7c95f9045cf tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:58.609972 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-83c1c710-1394-41ab-b82b-a7c95f9045cf tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:58.611035 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-83c1c710-1394-41ab-b82b-a7c95f9045cf tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:58.611633 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-83c1c710-1394-41ab-b82b-a7c95f9045cf tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:58.642794 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-83c1c710-1394-41ab-b82b-a7c95f9045cf tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051905 Oct 19 08:34:58.644249 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 791/1537] 10.222.0.26 () {58 vars in 1301 bytes} [Tue Oct 19 08:34:58 2021] GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 08:34:58.703402 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-50eba5d8-b820-4289-9703-f733ee4f809d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:58.704162 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-50eba5d8-b820-4289-9703-f733ee4f809d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:58.711879 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-50eba5d8-b820-4289-9703-f733ee4f809d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:58.712517 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-50eba5d8-b820-4289-9703-f733ee4f809d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:58.713486 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-50eba5d8-b820-4289-9703-f733ee4f809d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:58.714081 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-50eba5d8-b820-4289-9703-f733ee4f809d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:58.752430 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-50eba5d8-b820-4289-9703-f733ee4f809d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Going to try to terminate instance {{(pid=114105) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 19 08:34:58.871715 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-50eba5d8-b820-4289-9703-f733ee4f809d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55" status: 204 len: 0 microversion: 2.1 time: 0.171520 Oct 19 08:34:58.872871 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 747/1538] 10.222.0.26 () {58 vars in 1238 bytes} [Tue Oct 19 08:34:58 2021] DELETE /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 08:34:58.881771 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-88b00507-516d-4867-a094-f19d0f5761b4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:58.882378 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-88b00507-516d-4867-a094-f19d0f5761b4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:58.889393 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-88b00507-516d-4867-a094-f19d0f5761b4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:58.890386 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-88b00507-516d-4867-a094-f19d0f5761b4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:58.895026 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-88b00507-516d-4867-a094-f19d0f5761b4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:58.895674 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-88b00507-516d-4867-a094-f19d0f5761b4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:58.950693 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-bccf1422-b271-46c0-8354-bed8f26e3ab8 req-c195cefc-9fff-4fcb-93cb-19816b3c4f49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59c3fb17-9b00-4111-afa2-59ce69f7a986", "name": "network-vif-plugged", "status": "completed", "tag": "12a0882c-425b-45ca-9a64-43ef73c77095"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:34:58.956245 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:34:58.956245 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:34:58.963992 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-bccf1422-b271-46c0-8354-bed8f26e3ab8 req-c195cefc-9fff-4fcb-93cb-19816b3c4f49 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:58.964854 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-bccf1422-b271-46c0-8354-bed8f26e3ab8 req-c195cefc-9fff-4fcb-93cb-19816b3c4f49 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:58.978432 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-bccf1422-b271-46c0-8354-bed8f26e3ab8 req-c195cefc-9fff-4fcb-93cb-19816b3c4f49 service nova] Creating event network-vif-plugged:12a0882c-425b-45ca-9a64-43ef73c77095 for instance 59c3fb17-9b00-4111-afa2-59ce69f7a986 on hv-cinder-81398 Oct 19 08:34:58.983577 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-bccf1422-b271-46c0-8354-bed8f26e3ab8 req-c195cefc-9fff-4fcb-93cb-19816b3c4f49 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039028 Oct 19 08:34:58.984724 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 748/1539] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:34:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 08:34:59.143257 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-88b00507-516d-4867-a094-f19d0f5761b4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:59.151026 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-88b00507-516d-4867-a094-f19d0f5761b4 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55" status: 200 len: 1671 microversion: 2.1 time: 0.273001 Oct 19 08:34:59.151852 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 792/1540] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:58 2021] GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55 => generated 1671 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:34:59.295959 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8713d80f-32a9-445f-a79c-d3e879b897c6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:34:59.297128 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-8713d80f-32a9-445f-a79c-d3e879b897c6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:34:59.304251 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8713d80f-32a9-445f-a79c-d3e879b897c6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:59.304766 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8713d80f-32a9-445f-a79c-d3e879b897c6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:59.305672 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8713d80f-32a9-445f-a79c-d3e879b897c6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:34:59.306303 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8713d80f-32a9-445f-a79c-d3e879b897c6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:34:59.595356 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-8713d80f-32a9-445f-a79c-d3e879b897c6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:34:59.603619 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-8713d80f-32a9-445f-a79c-d3e879b897c6 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1576 microversion: 2.1 time: 0.311640 Oct 19 08:34:59.604175 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 749/1541] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:34:59 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1576 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:35:00.007368 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-cf78baa9-f236-47a2-a20b-d1017173ff7b req-cffc40ce-0ac2-4787-90e1-1085462b3215 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "532d2be2-d6f6-4402-b37b-574a504d3ab4", "tag": "c2ff330e-a352-4142-beea-72ad324f3271"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:35:00.009871 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:35:00.009871 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:35:00.020749 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-cf78baa9-f236-47a2-a20b-d1017173ff7b req-cffc40ce-0ac2-4787-90e1-1085462b3215 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:00.021195 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-cf78baa9-f236-47a2-a20b-d1017173ff7b req-cffc40ce-0ac2-4787-90e1-1085462b3215 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:00.033517 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-cf78baa9-f236-47a2-a20b-d1017173ff7b req-cffc40ce-0ac2-4787-90e1-1085462b3215 service nova] Creating event network-changed:c2ff330e-a352-4142-beea-72ad324f3271 for instance 532d2be2-d6f6-4402-b37b-574a504d3ab4 on hv-cinder-81398 Oct 19 08:35:00.039083 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-cf78baa9-f236-47a2-a20b-d1017173ff7b req-cffc40ce-0ac2-4787-90e1-1085462b3215 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035532 Oct 19 08:35:00.042549 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 793/1542] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:35:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:35:00.169172 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d0c93565-dcb3-4b9a-97e8-b149fd2209a2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:00.169777 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-d0c93565-dcb3-4b9a-97e8-b149fd2209a2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:35:00.178665 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d0c93565-dcb3-4b9a-97e8-b149fd2209a2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:00.179110 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d0c93565-dcb3-4b9a-97e8-b149fd2209a2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:00.179900 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d0c93565-dcb3-4b9a-97e8-b149fd2209a2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:00.180335 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-d0c93565-dcb3-4b9a-97e8-b149fd2209a2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:00.310715 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-d0c93565-dcb3-4b9a-97e8-b149fd2209a2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:35:00.318469 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-d0c93565-dcb3-4b9a-97e8-b149fd2209a2 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55" status: 200 len: 1671 microversion: 2.1 time: 0.153054 Oct 19 08:35:00.319063 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 750/1543] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:35:00 2021] GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:35:00.621524 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ffa1c0d9-7cf8-4a97-9867-2ef109b652f2 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:00.622226 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ffa1c0d9-7cf8-4a97-9867-2ef109b652f2 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:35:00.630074 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ffa1c0d9-7cf8-4a97-9867-2ef109b652f2 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:00.630448 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ffa1c0d9-7cf8-4a97-9867-2ef109b652f2 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:00.631248 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ffa1c0d9-7cf8-4a97-9867-2ef109b652f2 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:00.631681 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ffa1c0d9-7cf8-4a97-9867-2ef109b652f2 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:00.772618 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ffa1c0d9-7cf8-4a97-9867-2ef109b652f2 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:35:00.783254 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ffa1c0d9-7cf8-4a97-9867-2ef109b652f2 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1576 microversion: 2.1 time: 0.165791 Oct 19 08:35:00.783820 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 794/1544] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:35:00 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:35:01.335593 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-0ef42d10-9bc1-4521-b435-3b5286f956b1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:01.336217 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-0ef42d10-9bc1-4521-b435-3b5286f956b1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:35:01.342008 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0ef42d10-9bc1-4521-b435-3b5286f956b1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:01.342717 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0ef42d10-9bc1-4521-b435-3b5286f956b1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:01.343524 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0ef42d10-9bc1-4521-b435-3b5286f956b1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:01.343947 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0ef42d10-9bc1-4521-b435-3b5286f956b1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:01.463099 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-0ef42d10-9bc1-4521-b435-3b5286f956b1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:35:01.470461 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-0ef42d10-9bc1-4521-b435-3b5286f956b1 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55" status: 200 len: 1671 microversion: 2.1 time: 0.138577 Oct 19 08:35:01.471042 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 751/1545] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:35:01 2021] GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55 => generated 1671 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:35:01.799839 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-056205dc-8a8e-4f91-8c4a-3c564947668b tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:01.800446 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-056205dc-8a8e-4f91-8c4a-3c564947668b tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:35:01.806157 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-056205dc-8a8e-4f91-8c4a-3c564947668b tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:01.806649 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-056205dc-8a8e-4f91-8c4a-3c564947668b tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:01.807412 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-056205dc-8a8e-4f91-8c4a-3c564947668b tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:01.807842 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-056205dc-8a8e-4f91-8c4a-3c564947668b tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:01.935453 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-056205dc-8a8e-4f91-8c4a-3c564947668b tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:35:01.942902 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-056205dc-8a8e-4f91-8c4a-3c564947668b tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1563 microversion: 2.1 time: 0.147250 Oct 19 08:35:01.943488 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 795/1546] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:35:01 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1563 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:35:02.490814 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-5471bd54-790e-4f52-9e7c-138f518593dd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:02.491803 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-5471bd54-790e-4f52-9e7c-138f518593dd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:35:02.498249 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5471bd54-790e-4f52-9e7c-138f518593dd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:02.498923 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5471bd54-790e-4f52-9e7c-138f518593dd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:02.499798 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5471bd54-790e-4f52-9e7c-138f518593dd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:02.500226 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5471bd54-790e-4f52-9e7c-138f518593dd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:02.560119 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-5471bd54-790e-4f52-9e7c-138f518593dd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8dea90b58a49b391bec5f0a04acb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039e505af3b42a3afdc9ac76295e901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:35:02.567935 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-5471bd54-790e-4f52-9e7c-138f518593dd tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55" status: 200 len: 1605 microversion: 2.1 time: 0.083965 Oct 19 08:35:02.568504 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 752/1547] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:35:02 2021] GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55 => generated 1605 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:35:02.725498 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-018aef00-f5cc-46dc-8e92-d49705cc3576 req-9d5f4870-c905-4ddd-9471-3443db6c48f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8da1c23b-61b7-480c-b3b4-90f5793c0f55", "name": "network-vif-deleted", "tag": "7532eae6-a4a9-45d4-a23f-5cc7a5b33a17"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:35:02.728224 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:35:02.728224 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:35:02.738699 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-018aef00-f5cc-46dc-8e92-d49705cc3576 req-9d5f4870-c905-4ddd-9471-3443db6c48f2 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:02.739138 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-018aef00-f5cc-46dc-8e92-d49705cc3576 req-9d5f4870-c905-4ddd-9471-3443db6c48f2 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:02.753262 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-018aef00-f5cc-46dc-8e92-d49705cc3576 req-9d5f4870-c905-4ddd-9471-3443db6c48f2 service nova] Creating event network-vif-deleted:7532eae6-a4a9-45d4-a23f-5cc7a5b33a17 for instance 8da1c23b-61b7-480c-b3b4-90f5793c0f55 on hv-cinder-81398 Oct 19 08:35:02.758857 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-018aef00-f5cc-46dc-8e92-d49705cc3576 req-9d5f4870-c905-4ddd-9471-3443db6c48f2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037095 Oct 19 08:35:02.759462 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 796/1548] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:35:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:35:03.585465 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-a023f452-8aaa-41d6-8736-ad4d3d3d02cb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:03.586073 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-a023f452-8aaa-41d6-8736-ad4d3d3d02cb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:35:03.591950 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a023f452-8aaa-41d6-8736-ad4d3d3d02cb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:03.593063 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a023f452-8aaa-41d6-8736-ad4d3d3d02cb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:03.593921 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a023f452-8aaa-41d6-8736-ad4d3d3d02cb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:03.594354 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a023f452-8aaa-41d6-8736-ad4d3d3d02cb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:03.607912 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.wsgi [None req-a023f452-8aaa-41d6-8736-ad4d3d3d02cb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] HTTP exception thrown: Instance 8da1c23b-61b7-480c-b3b4-90f5793c0f55 could not be found. Oct 19 08:35:03.608643 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-a023f452-8aaa-41d6-8736-ad4d3d3d02cb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Returning 404 to user: Instance 8da1c23b-61b7-480c-b3b4-90f5793c0f55 could not be found. {{(pid=114105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:35:03.609473 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-a023f452-8aaa-41d6-8736-ad4d3d3d02cb tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55" status: 404 len: 111 microversion: 2.1 time: 0.027783 Oct 19 08:35:03.610015 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 753/1549] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:35:03 2021] GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:35:03.619071 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-1c12f2f7-efd6-4381-83f8-a651fae26f5d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '.version_select at 0x7fcaddacc160>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:03.637268 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-1c12f2f7-efd6-4381-83f8-a651fae26f5d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1123495117" status: 202 len: 0 microversion: 2.1 time: 0.022441 Oct 19 08:35:03.637852 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 797/1550] 10.222.0.26 () {58 vars in 1220 bytes} [Tue Oct 19 08:35:03 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1123495117 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 08:35:06.522745 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-0db5a4e1-a914-433d-8e64-aa1188f8ab2d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:06.523236 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-0db5a4e1-a914-433d-8e64-aa1188f8ab2d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:35:06.528916 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0db5a4e1-a914-433d-8e64-aa1188f8ab2d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:06.529347 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0db5a4e1-a914-433d-8e64-aa1188f8ab2d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:06.530090 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0db5a4e1-a914-433d-8e64-aa1188f8ab2d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:06.530533 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-0db5a4e1-a914-433d-8e64-aa1188f8ab2d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:06.543816 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.wsgi [None req-0db5a4e1-a914-433d-8e64-aa1188f8ab2d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] HTTP exception thrown: Instance 8da1c23b-61b7-480c-b3b4-90f5793c0f55 could not be found. Oct 19 08:35:06.544387 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-0db5a4e1-a914-433d-8e64-aa1188f8ab2d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Returning 404 to user: Instance 8da1c23b-61b7-480c-b3b4-90f5793c0f55 could not be found. {{(pid=114105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:35:06.545174 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-0db5a4e1-a914-433d-8e64-aa1188f8ab2d tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55" status: 404 len: 111 microversion: 2.1 time: 0.026245 Oct 19 08:35:06.545671 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 754/1551] 10.222.0.26 () {58 vars in 1238 bytes} [Tue Oct 19 08:35:06 2021] DELETE /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:35:06.553332 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-70cb0243-6e59-4c3a-b58b-1c577104acbc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:06.554050 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-70cb0243-6e59-4c3a-b58b-1c577104acbc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 8da1c23b-61b7-480c-b3b4-90f5793c0f55] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:35:06.560625 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-70cb0243-6e59-4c3a-b58b-1c577104acbc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:06.561080 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-70cb0243-6e59-4c3a-b58b-1c577104acbc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:06.561845 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-70cb0243-6e59-4c3a-b58b-1c577104acbc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:06.562306 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-70cb0243-6e59-4c3a-b58b-1c577104acbc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:06.575284 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.wsgi [None req-70cb0243-6e59-4c3a-b58b-1c577104acbc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] HTTP exception thrown: Instance 8da1c23b-61b7-480c-b3b4-90f5793c0f55 could not be found. Oct 19 08:35:06.575871 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-70cb0243-6e59-4c3a-b58b-1c577104acbc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Returning 404 to user: Instance 8da1c23b-61b7-480c-b3b4-90f5793c0f55 could not be found. {{(pid=114106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:35:06.576682 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-70cb0243-6e59-4c3a-b58b-1c577104acbc tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55" status: 404 len: 111 microversion: 2.1 time: 0.026993 Oct 19 08:35:06.577205 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 798/1552] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:35:06 2021] GET /compute/v2.1/servers/8da1c23b-61b7-480c-b3b4-90f5793c0f55 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:35:07.700734 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-47cddfee-cc73-46ef-a849-d4796559dca8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:07.701210 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-47cddfee-cc73-46ef-a849-d4796559dca8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:35:07.707587 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-47cddfee-cc73-46ef-a849-d4796559dca8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:07.708024 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-47cddfee-cc73-46ef-a849-d4796559dca8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:07.708771 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-47cddfee-cc73-46ef-a849-d4796559dca8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:07.709198 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-47cddfee-cc73-46ef-a849-d4796559dca8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:07.721834 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.wsgi [None req-47cddfee-cc73-46ef-a849-d4796559dca8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] HTTP exception thrown: Instance 30b1ba9b-8d31-4658-9d03-3be46d4f7504 could not be found. Oct 19 08:35:07.722403 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-47cddfee-cc73-46ef-a849-d4796559dca8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Returning 404 to user: Instance 30b1ba9b-8d31-4658-9d03-3be46d4f7504 could not be found. {{(pid=114105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:35:07.723217 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-47cddfee-cc73-46ef-a849-d4796559dca8 tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "DELETE /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 404 len: 111 microversion: 2.1 time: 0.026180 Oct 19 08:35:07.723718 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 755/1553] 10.222.0.26 () {58 vars in 1238 bytes} [Tue Oct 19 08:35:07 2021] DELETE /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:35:07.731503 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c8d7f6f0-484f-4fe2-9c9d-d5067a1db00e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:07.732113 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c8d7f6f0-484f-4fe2-9c9d-d5067a1db00e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] [instance: 30b1ba9b-8d31-4658-9d03-3be46d4f7504] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:35:07.738093 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c8d7f6f0-484f-4fe2-9c9d-d5067a1db00e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:07.738605 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c8d7f6f0-484f-4fe2-9c9d-d5067a1db00e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:07.739377 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c8d7f6f0-484f-4fe2-9c9d-d5067a1db00e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:07.739792 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c8d7f6f0-484f-4fe2-9c9d-d5067a1db00e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:07.753888 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.wsgi [None req-c8d7f6f0-484f-4fe2-9c9d-d5067a1db00e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] HTTP exception thrown: Instance 30b1ba9b-8d31-4658-9d03-3be46d4f7504 could not be found. Oct 19 08:35:07.754506 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c8d7f6f0-484f-4fe2-9c9d-d5067a1db00e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] Returning 404 to user: Instance 30b1ba9b-8d31-4658-9d03-3be46d4f7504 could not be found. {{(pid=114106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:35:07.755307 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c8d7f6f0-484f-4fe2-9c9d-d5067a1db00e tempest-AttachVolumeTestJSON-1579651942 tempest-AttachVolumeTestJSON-1579651942-project] 10.222.0.26 "GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504" status: 404 len: 111 microversion: 2.1 time: 0.027438 Oct 19 08:35:07.755822 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 799/1554] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:35:07 2021] GET /compute/v2.1/servers/30b1ba9b-8d31-4658-9d03-3be46d4f7504 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:35:13.502937 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-434f6fd1-3205-456a-9965-3bbaa4dabbd9 tempest-VolumesTestJSON-1905671020 tempest-VolumesTestJSON-1905671020-project] Calling method '.version_select at 0x7fcadd12fe50>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:13.547843 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-434f6fd1-3205-456a-9965-3bbaa4dabbd9 tempest-VolumesTestJSON-1905671020 tempest-VolumesTestJSON-1905671020-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/7dc18309-06bc-4427-9b37-7e2864f68680" status: 200 len: 348 microversion: 2.1 time: 0.048815 Oct 19 08:35:13.548350 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 756/1555] 10.222.0.26 () {58 vars in 1244 bytes} [Tue Oct 19 08:35:13 2021] GET /compute/v2.1/os-volumes/7dc18309-06bc-4427-9b37-7e2864f68680 => generated 348 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:35:14.846394 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c1c7c1bb-41eb-4823-a08d-d42f3bff55b0 tempest-VolumesTestJSON-1905671020 tempest-VolumesTestJSON-1905671020-project] Calling method '.version_select at 0x7fcaddd94820>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:14.892343 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c1c7c1bb-41eb-4823-a08d-d42f3bff55b0 tempest-VolumesTestJSON-1905671020 tempest-VolumesTestJSON-1905671020-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/ce84cf19-8a86-4d52-b5a5-8880b5deea94" status: 200 len: 351 microversion: 2.1 time: 0.051521 Oct 19 08:35:14.892897 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 800/1556] 10.222.0.26 () {58 vars in 1244 bytes} [Tue Oct 19 08:35:14 2021] GET /compute/v2.1/os-volumes/ce84cf19-8a86-4d52-b5a5-8880b5deea94 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:35:16.193515 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-037c3b41-026a-4bf8-96fc-57de71af8e01 tempest-VolumesTestJSON-1905671020 tempest-VolumesTestJSON-1905671020-project] Calling method '.version_select at 0x7fcae1f880d0>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:16.237624 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-037c3b41-026a-4bf8-96fc-57de71af8e01 tempest-VolumesTestJSON-1905671020 tempest-VolumesTestJSON-1905671020-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/303f6b9e-4402-47a0-aa43-7f24ecdb3a91" status: 200 len: 350 microversion: 2.1 time: 0.047762 Oct 19 08:35:16.238181 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 757/1557] 10.222.0.26 () {58 vars in 1244 bytes} [Tue Oct 19 08:35:16 2021] GET /compute/v2.1/os-volumes/303f6b9e-4402-47a0-aa43-7f24ecdb3a91 => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:35:16.249462 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-de12c095-d42c-4ea7-b1ff-50d2c04a2ad2 tempest-VolumesTestJSON-1905671020 tempest-VolumesTestJSON-1905671020-project] Calling method '.version_select at 0x7fcaddacc790>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:16.327263 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-de12c095-d42c-4ea7-b1ff-50d2c04a2ad2 tempest-VolumesTestJSON-1905671020 tempest-VolumesTestJSON-1905671020-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.081264 Oct 19 08:35:16.327813 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 801/1558] 10.222.0.26 () {58 vars in 1133 bytes} [Tue Oct 19 08:35:16 2021] GET /compute/v2.1/os-volumes => generated 1032 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:35:16.340157 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c2286fc7-c36d-4b97-8d79-079c27492529 tempest-VolumesTestJSON-1905671020 tempest-VolumesTestJSON-1905671020-project] Calling method '.version_select at 0x7fcae1fff820>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:16.421901 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-c2286fc7-c36d-4b97-8d79-079c27492529 tempest-VolumesTestJSON-1905671020 tempest-VolumesTestJSON-1905671020-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085281 Oct 19 08:35:16.422468 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 758/1559] 10.222.0.26 () {58 vars in 1148 bytes} [Tue Oct 19 08:35:16 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:35:16.434481 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-75b2a73e-1035-4c69-ad42-65489daf842d tempest-VolumesTestJSON-1905671020 tempest-VolumesTestJSON-1905671020-project] Calling method '.version_select at 0x7fcaddad31f0>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:16.516546 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-75b2a73e-1035-4c69-ad42-65489daf842d tempest-VolumesTestJSON-1905671020 tempest-VolumesTestJSON-1905671020-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.085500 Oct 19 08:35:16.517160 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 802/1560] 10.222.0.26 () {58 vars in 1133 bytes} [Tue Oct 19 08:35:16 2021] GET /compute/v2.1/os-volumes => generated 1032 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:35:16.528089 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-1f11d456-8bc3-4bc1-b351-e9d0ad33fb20 tempest-VolumesTestJSON-1905671020 tempest-VolumesTestJSON-1905671020-project] Calling method '.version_select at 0x7fcae1f885e0>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:16.607231 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-1f11d456-8bc3-4bc1-b351-e9d0ad33fb20 tempest-VolumesTestJSON-1905671020 tempest-VolumesTestJSON-1905671020-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.082668 Oct 19 08:35:16.607821 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 759/1561] 10.222.0.26 () {58 vars in 1166 bytes} [Tue Oct 19 08:35:16 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:35:16.619726 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-16ea6cfa-3e82-495c-905d-67865726bc8f tempest-VolumesTestJSON-1905671020 tempest-VolumesTestJSON-1905671020-project] Calling method '.version_select at 0x7fcadda88e50>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:16.699157 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-16ea6cfa-3e82-495c-905d-67865726bc8f tempest-VolumesTestJSON-1905671020 tempest-VolumesTestJSON-1905671020-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.082918 Oct 19 08:35:16.699721 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 803/1562] 10.222.0.26 () {58 vars in 1169 bytes} [Tue Oct 19 08:35:16 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:35:16.711326 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-57af194b-b468-4133-9391-ee941a1935c4 tempest-VolumesTestJSON-1905671020 tempest-VolumesTestJSON-1905671020-project] Calling method '.version_select at 0x7fcadd12f8b0>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:16.790365 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-57af194b-b468-4133-9391-ee941a1935c4 tempest-VolumesTestJSON-1905671020 tempest-VolumesTestJSON-1905671020-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.082525 Oct 19 08:35:16.790966 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 760/1563] 10.222.0.26 () {58 vars in 1154 bytes} [Tue Oct 19 08:35:16 2021] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:35:16.802420 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-bdd47703-221f-4c6d-ac41-76df3594c92c tempest-VolumesTestJSON-1905671020 tempest-VolumesTestJSON-1905671020-project] Calling method '.version_select at 0x7fcadcfab160>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:16.883930 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-bdd47703-221f-4c6d-ac41-76df3594c92c tempest-VolumesTestJSON-1905671020 tempest-VolumesTestJSON-1905671020-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085037 Oct 19 08:35:16.884513 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 804/1564] 10.222.0.26 () {58 vars in 1187 bytes} [Tue Oct 19 08:35:16 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:35:16.896215 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d0ce37a5-c2f4-4491-b2c6-fbc67a1ee076 tempest-VolumesTestJSON-1905671020 tempest-VolumesTestJSON-1905671020-project] Calling method '.version_select at 0x7fcae1fff430>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:16.975753 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-d0ce37a5-c2f4-4491-b2c6-fbc67a1ee076 tempest-VolumesTestJSON-1905671020 tempest-VolumesTestJSON-1905671020-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.083095 Oct 19 08:35:16.976306 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 761/1565] 10.222.0.26 () {58 vars in 1154 bytes} [Tue Oct 19 08:35:16 2021] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:35:50.433969 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-364d95a0-83d3-4a3d-b8b5-e06f2864f317 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:50.434920 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-364d95a0-83d3-4a3d-b8b5-e06f2864f317 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:35:50.441961 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-364d95a0-83d3-4a3d-b8b5-e06f2864f317 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:50.442401 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-364d95a0-83d3-4a3d-b8b5-e06f2864f317 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:50.443222 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-364d95a0-83d3-4a3d-b8b5-e06f2864f317 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:50.443680 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-364d95a0-83d3-4a3d-b8b5-e06f2864f317 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:50.472481 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-364d95a0-83d3-4a3d-b8b5-e06f2864f317 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043045 Oct 19 08:35:50.473043 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 805/1566] 10.222.0.26 () {60 vars in 1342 bytes} [Tue Oct 19 08:35:50 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:35:50.527522 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-a6cf3567-0c98-425f-bf06-ecaae78daedf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:50.528016 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-a6cf3567-0c98-425f-bf06-ecaae78daedf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:35:50.533832 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a6cf3567-0c98-425f-bf06-ecaae78daedf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:50.534301 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a6cf3567-0c98-425f-bf06-ecaae78daedf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:50.535094 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a6cf3567-0c98-425f-bf06-ecaae78daedf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:50.535523 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a6cf3567-0c98-425f-bf06-ecaae78daedf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:50.558803 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-a6cf3567-0c98-425f-bf06-ecaae78daedf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Going to try to terminate instance {{(pid=114105) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 19 08:35:50.630018 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-a6cf3567-0c98-425f-bf06-ecaae78daedf tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "DELETE /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 204 len: 0 microversion: 2.20 time: 0.106637 Oct 19 08:35:50.630853 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 762/1567] 10.222.0.26 () {60 vars in 1279 bytes} [Tue Oct 19 08:35:50 2021] DELETE /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 08:35:50.638436 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-f63639b4-ef40-4f08-83e2-2e590478ed8b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:50.638992 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-f63639b4-ef40-4f08-83e2-2e590478ed8b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:35:50.645750 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f63639b4-ef40-4f08-83e2-2e590478ed8b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:50.646193 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f63639b4-ef40-4f08-83e2-2e590478ed8b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:50.646972 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f63639b4-ef40-4f08-83e2-2e590478ed8b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:50.647397 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f63639b4-ef40-4f08-83e2-2e590478ed8b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:50.768339 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-f63639b4-ef40-4f08-83e2-2e590478ed8b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:35:50.775970 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-f63639b4-ef40-4f08-83e2-2e590478ed8b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:35:50.777454 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-f63639b4-ef40-4f08-83e2-2e590478ed8b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:35:50.778633 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-f63639b4-ef40-4f08-83e2-2e590478ed8b tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1724 microversion: 2.20 time: 0.143894 Oct 19 08:35:50.779188 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 806/1568] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:35:50 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1724 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:35:51.797755 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-5a7886cc-85f9-48b4-bff8-82047524bb73 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:51.798588 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-5a7886cc-85f9-48b4-bff8-82047524bb73 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:35:51.804619 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5a7886cc-85f9-48b4-bff8-82047524bb73 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:51.805057 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5a7886cc-85f9-48b4-bff8-82047524bb73 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:51.805808 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5a7886cc-85f9-48b4-bff8-82047524bb73 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:51.806229 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-5a7886cc-85f9-48b4-bff8-82047524bb73 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:51.929612 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-5a7886cc-85f9-48b4-bff8-82047524bb73 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:35:51.937858 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-5a7886cc-85f9-48b4-bff8-82047524bb73 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:35:51.939893 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-5a7886cc-85f9-48b4-bff8-82047524bb73 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:35:51.941085 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-5a7886cc-85f9-48b4-bff8-82047524bb73 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1724 microversion: 2.20 time: 0.147993 Oct 19 08:35:51.941640 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 763/1569] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:35:51 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 08:35:52.959285 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-9f030256-e1cc-4803-bdc4-9bdbab56e5dc tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:52.959880 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-9f030256-e1cc-4803-bdc4-9bdbab56e5dc tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:35:52.965650 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9f030256-e1cc-4803-bdc4-9bdbab56e5dc tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:52.966030 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9f030256-e1cc-4803-bdc4-9bdbab56e5dc tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:52.966794 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9f030256-e1cc-4803-bdc4-9bdbab56e5dc tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:52.967219 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9f030256-e1cc-4803-bdc4-9bdbab56e5dc tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:53.027810 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-9f030256-e1cc-4803-bdc4-9bdbab56e5dc tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:35:53.036494 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-9f030256-e1cc-4803-bdc4-9bdbab56e5dc tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:35:53.038027 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-9f030256-e1cc-4803-bdc4-9bdbab56e5dc tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ba4c5d03e21424eb9b326bddefbf34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffc881ce1324822826aec5e72a754b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:35:53.039212 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-9f030256-e1cc-4803-bdc4-9bdbab56e5dc tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 200 len: 1656 microversion: 2.20 time: 0.083715 Oct 19 08:35:53.039764 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 807/1570] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:35:52 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 1656 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 08:35:53.166571 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-3925221a-5cac-4d0c-b6ab-73415054c58d req-8a5ef867-3e15-42df-88ff-83c91bb9bce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15322fb9-3685-4ce3-9f4d-9a407835f47a", "name": "network-vif-deleted", "tag": "5a96c138-97d6-476d-b751-ac066e4a3cef"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:35:53.168309 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:35:53.168309 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:35:53.177428 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-3925221a-5cac-4d0c-b6ab-73415054c58d req-8a5ef867-3e15-42df-88ff-83c91bb9bce5 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:53.177872 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-3925221a-5cac-4d0c-b6ab-73415054c58d req-8a5ef867-3e15-42df-88ff-83c91bb9bce5 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:53.191750 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-3925221a-5cac-4d0c-b6ab-73415054c58d req-8a5ef867-3e15-42df-88ff-83c91bb9bce5 service nova] Creating event network-vif-deleted:5a96c138-97d6-476d-b751-ac066e4a3cef for instance 15322fb9-3685-4ce3-9f4d-9a407835f47a on hv-cinder-81398 Oct 19 08:35:53.198279 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-3925221a-5cac-4d0c-b6ab-73415054c58d req-8a5ef867-3e15-42df-88ff-83c91bb9bce5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035578 Oct 19 08:35:53.198989 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 764/1571] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:35:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:35:54.057134 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e403d803-b1d5-4223-9294-24e00519f7e5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:54.057757 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e403d803-b1d5-4223-9294-24e00519f7e5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:35:54.064135 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e403d803-b1d5-4223-9294-24e00519f7e5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:54.064589 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e403d803-b1d5-4223-9294-24e00519f7e5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:54.065366 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e403d803-b1d5-4223-9294-24e00519f7e5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:54.065798 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e403d803-b1d5-4223-9294-24e00519f7e5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:54.079679 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.wsgi [None req-e403d803-b1d5-4223-9294-24e00519f7e5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] HTTP exception thrown: Instance 15322fb9-3685-4ce3-9f4d-9a407835f47a could not be found. Oct 19 08:35:54.080259 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e403d803-b1d5-4223-9294-24e00519f7e5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Returning 404 to user: Instance 15322fb9-3685-4ce3-9f4d-9a407835f47a could not be found. {{(pid=114106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:35:54.081070 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e403d803-b1d5-4223-9294-24e00519f7e5 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 404 len: 111 microversion: 2.20 time: 0.027764 Oct 19 08:35:54.081603 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 808/1572] 10.222.0.26 () {60 vars in 1276 bytes} [Tue Oct 19 08:35:54 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 08:35:54.090174 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-165a4aa9-0ceb-4595-969e-87f266f15bb8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '.version_select at 0x7fcae20571f0>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:54.114001 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-165a4aa9-0ceb-4595-969e-87f266f15bb8 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-283748760" status: 204 len: 0 microversion: 2.20 time: 0.027642 Oct 19 08:35:54.114613 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 765/1573] 10.222.0.26 () {60 vars in 1258 bytes} [Tue Oct 19 08:35:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-283748760 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 19 08:35:56.130548 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-23c1a6db-bed7-4fae-82dc-da0ca82b4283 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:56.131044 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-23c1a6db-bed7-4fae-82dc-da0ca82b4283 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:35:56.136763 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-23c1a6db-bed7-4fae-82dc-da0ca82b4283 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:56.137205 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-23c1a6db-bed7-4fae-82dc-da0ca82b4283 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:56.137965 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-23c1a6db-bed7-4fae-82dc-da0ca82b4283 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:56.138397 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-23c1a6db-bed7-4fae-82dc-da0ca82b4283 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:56.152190 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.wsgi [None req-23c1a6db-bed7-4fae-82dc-da0ca82b4283 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] HTTP exception thrown: Instance 15322fb9-3685-4ce3-9f4d-9a407835f47a could not be found. Oct 19 08:35:56.152699 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-23c1a6db-bed7-4fae-82dc-da0ca82b4283 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Returning 404 to user: Instance 15322fb9-3685-4ce3-9f4d-9a407835f47a could not be found. {{(pid=114106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:35:56.153493 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-23c1a6db-bed7-4fae-82dc-da0ca82b4283 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "DELETE /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 404 len: 111 microversion: 2.1 time: 0.026838 Oct 19 08:35:56.154056 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 809/1574] 10.222.0.26 () {58 vars in 1238 bytes} [Tue Oct 19 08:35:56 2021] DELETE /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 08:35:56.162293 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c5c8782b-cc65-4ba0-addc-d34efec5d338 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:56.163053 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-c5c8782b-cc65-4ba0-addc-d34efec5d338 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: 15322fb9-3685-4ce3-9f4d-9a407835f47a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:35:56.169219 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c5c8782b-cc65-4ba0-addc-d34efec5d338 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:56.169663 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c5c8782b-cc65-4ba0-addc-d34efec5d338 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:56.170421 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c5c8782b-cc65-4ba0-addc-d34efec5d338 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:56.170881 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c5c8782b-cc65-4ba0-addc-d34efec5d338 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:56.183927 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.wsgi [None req-c5c8782b-cc65-4ba0-addc-d34efec5d338 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] HTTP exception thrown: Instance 15322fb9-3685-4ce3-9f4d-9a407835f47a could not be found. Oct 19 08:35:56.184516 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c5c8782b-cc65-4ba0-addc-d34efec5d338 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Returning 404 to user: Instance 15322fb9-3685-4ce3-9f4d-9a407835f47a could not be found. {{(pid=114105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:35:56.185326 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-c5c8782b-cc65-4ba0-addc-d34efec5d338 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a" status: 404 len: 111 microversion: 2.1 time: 0.026747 Oct 19 08:35:56.185859 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 766/1575] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:35:56 2021] GET /compute/v2.1/servers/15322fb9-3685-4ce3-9f4d-9a407835f47a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:35:57.311223 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-12777efc-2dc0-4fe2-847f-d3717a1565b2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:57.311742 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-12777efc-2dc0-4fe2-847f-d3717a1565b2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:35:57.317825 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-12777efc-2dc0-4fe2-847f-d3717a1565b2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:57.318266 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-12777efc-2dc0-4fe2-847f-d3717a1565b2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:57.319497 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-12777efc-2dc0-4fe2-847f-d3717a1565b2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:57.320025 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-12777efc-2dc0-4fe2-847f-d3717a1565b2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:57.336736 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.wsgi [None req-12777efc-2dc0-4fe2-847f-d3717a1565b2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] HTTP exception thrown: Instance fe7dae80-4592-45ea-a52d-05aa559c102a could not be found. Oct 19 08:35:57.337317 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-12777efc-2dc0-4fe2-847f-d3717a1565b2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Returning 404 to user: Instance fe7dae80-4592-45ea-a52d-05aa559c102a could not be found. {{(pid=114106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:35:57.338133 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-12777efc-2dc0-4fe2-847f-d3717a1565b2 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 404 len: 111 microversion: 2.1 time: 0.031142 Oct 19 08:35:57.338689 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 810/1576] 10.222.0.26 () {58 vars in 1238 bytes} [Tue Oct 19 08:35:57 2021] DELETE /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:35:57.347313 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-f1a93f78-19cd-48df-aab2-a74f5de5ba95 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:35:57.347918 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-f1a93f78-19cd-48df-aab2-a74f5de5ba95 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] [instance: fe7dae80-4592-45ea-a52d-05aa559c102a] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:35:57.353876 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f1a93f78-19cd-48df-aab2-a74f5de5ba95 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:57.354319 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f1a93f78-19cd-48df-aab2-a74f5de5ba95 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:57.355145 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f1a93f78-19cd-48df-aab2-a74f5de5ba95 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:35:57.355889 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f1a93f78-19cd-48df-aab2-a74f5de5ba95 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:35:57.370933 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.wsgi [None req-f1a93f78-19cd-48df-aab2-a74f5de5ba95 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] HTTP exception thrown: Instance fe7dae80-4592-45ea-a52d-05aa559c102a could not be found. Oct 19 08:35:57.371518 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-f1a93f78-19cd-48df-aab2-a74f5de5ba95 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] Returning 404 to user: Instance fe7dae80-4592-45ea-a52d-05aa559c102a could not be found. {{(pid=114105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:35:57.372739 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-f1a93f78-19cd-48df-aab2-a74f5de5ba95 tempest-AttachVolumeShelveTestJSON-347074079 tempest-AttachVolumeShelveTestJSON-347074079-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a" status: 404 len: 111 microversion: 2.1 time: 0.029341 Oct 19 08:35:57.373666 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 767/1577] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:35:57 2021] GET /compute/v2.1/servers/fe7dae80-4592-45ea-a52d-05aa559c102a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:36:27.925215 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-d768def6-d557-4320-b2bb-4c349cc0a232 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-483439581", "imageRef": "9102a998-a580-4b4e-b6a1-3172273dd66d", "flavorRef": "452", "networks": [{"uuid": "99f587ad-50a2-4763-8d6f-46d8c355845a"}]}} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:36:27.978199 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.network.neutron [None req-d768def6-d557-4320-b2bb-4c349cc0a232 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] validate_networks() for [('99f587ad-50a2-4763-8d6f-46d8c355845a', None, None, None, None, None)] {{(pid=114106) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 19 08:36:28.369183 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-d768def6-d557-4320-b2bb-4c349cc0a232 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Flavor limits 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 08:36:28.369601 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-d768def6-d557-4320-b2bb-4c349cc0a232 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Image limits 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 08:36:28.370093 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-d768def6-d557-4320-b2bb-4c349cc0a232 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Flavor pref 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 08:36:28.370516 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-d768def6-d557-4320-b2bb-4c349cc0a232 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Image pref 0:0:0 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 08:36:28.370918 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.virt.hardware [None req-d768def6-d557-4320-b2bb-4c349cc0a232 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 08:36:28.380214 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d768def6-d557-4320-b2bb-4c349cc0a232 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:28.380652 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d768def6-d557-4320-b2bb-4c349cc0a232 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:28.381438 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d768def6-d557-4320-b2bb-4c349cc0a232 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:28.381861 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-d768def6-d557-4320-b2bb-4c349cc0a232 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:28.397755 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-d768def6-d557-4320-b2bb-4c349cc0a232 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Getting quotas for project ab690ea015684fd0a5fb3fd3b162b6a7. Resources: {'cores', 'instances', 'ram'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:36:28.401649 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.quota [None req-d768def6-d557-4320-b2bb-4c349cc0a232 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Getting quotas for user 8734210db2404107bb002f83f73ce02f and project ab690ea015684fd0a5fb3fd3b162b6a7. Resources: {'cores', 'instances', 'ram'} {{(pid=114106) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:36:28.412234 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-d768def6-d557-4320-b2bb-4c349cc0a232 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Going to run 1 instances... {{(pid=114106) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 19 08:36:28.414540 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-d768def6-d557-4320-b2bb-4c349cc0a232 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: d9caf46a-f22c-4f22-ac19-8acb57190713] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9102a998-a580-4b4e-b6a1-3172273dd66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114106) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 19 08:36:28.458746 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-d768def6-d557-4320-b2bb-4c349cc0a232 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538030 Oct 19 08:36:28.459370 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 811/1578] 10.222.0.26 () {60 vars in 1146 bytes} [Tue Oct 19 08:36:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 08:36:28.469410 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8aba96b3-e44a-4dc2-b707-f31aebfe0e49 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:28.470024 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-8aba96b3-e44a-4dc2-b707-f31aebfe0e49 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: d9caf46a-f22c-4f22-ac19-8acb57190713] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:28.523070 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-8aba96b3-e44a-4dc2-b707-f31aebfe0e49 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8734210db2404107bb002f83f73ce02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab690ea015684fd0a5fb3fd3b162b6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:36:28.529495 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-8aba96b3-e44a-4dc2-b707-f31aebfe0e49 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "GET /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713" status: 200 len: 1213 microversion: 2.1 time: 0.064095 Oct 19 08:36:28.530362 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 768/1579] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:28 2021] GET /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713 => generated 1213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:36:29.553537 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-1759a62e-011d-4107-a6bf-693d2af10551 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:29.554229 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-1759a62e-011d-4107-a6bf-693d2af10551 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: d9caf46a-f22c-4f22-ac19-8acb57190713] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:29.560021 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1759a62e-011d-4107-a6bf-693d2af10551 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:29.560459 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1759a62e-011d-4107-a6bf-693d2af10551 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:29.561228 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1759a62e-011d-4107-a6bf-693d2af10551 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:29.561661 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-1759a62e-011d-4107-a6bf-693d2af10551 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:29.622298 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-1759a62e-011d-4107-a6bf-693d2af10551 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8734210db2404107bb002f83f73ce02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab690ea015684fd0a5fb3fd3b162b6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:36:29.630400 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-1759a62e-011d-4107-a6bf-693d2af10551 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "GET /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713" status: 200 len: 1271 microversion: 2.1 time: 0.086895 Oct 19 08:36:29.631006 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 812/1580] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:29 2021] GET /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:36:30.542627 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-ab16740e-9806-45f1-a55f-4486f927318c req-6da945d5-6205-4483-adf5-aa449bc93652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9caf46a-f22c-4f22-ac19-8acb57190713", "tag": "532adc10-dcd7-402b-83d9-f99e62b6924c"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:36:30.544855 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:36:30.544855 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:36:30.553055 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-ab16740e-9806-45f1-a55f-4486f927318c req-6da945d5-6205-4483-adf5-aa449bc93652 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:30.553506 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-ab16740e-9806-45f1-a55f-4486f927318c req-6da945d5-6205-4483-adf5-aa449bc93652 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:30.564960 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-ab16740e-9806-45f1-a55f-4486f927318c req-6da945d5-6205-4483-adf5-aa449bc93652 service nova] Creating event network-changed:532adc10-dcd7-402b-83d9-f99e62b6924c for instance d9caf46a-f22c-4f22-ac19-8acb57190713 on hv-cinder-81398 Oct 19 08:36:30.569969 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-ab16740e-9806-45f1-a55f-4486f927318c req-6da945d5-6205-4483-adf5-aa449bc93652 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031237 Oct 19 08:36:30.570758 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 769/1581] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:36:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:36:30.648345 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-40134654-9d97-49ca-96ed-9dc9e99f5147 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:30.649066 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-40134654-9d97-49ca-96ed-9dc9e99f5147 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: d9caf46a-f22c-4f22-ac19-8acb57190713] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:30.655086 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-40134654-9d97-49ca-96ed-9dc9e99f5147 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:30.655530 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-40134654-9d97-49ca-96ed-9dc9e99f5147 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:30.656285 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-40134654-9d97-49ca-96ed-9dc9e99f5147 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:30.656714 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-40134654-9d97-49ca-96ed-9dc9e99f5147 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:30.775436 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-40134654-9d97-49ca-96ed-9dc9e99f5147 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8734210db2404107bb002f83f73ce02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab690ea015684fd0a5fb3fd3b162b6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:36:30.782643 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-40134654-9d97-49ca-96ed-9dc9e99f5147 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "GET /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713" status: 200 len: 1313 microversion: 2.1 time: 0.138154 Oct 19 08:36:30.783266 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 813/1582] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:30 2021] GET /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713 => generated 1313 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:36:31.801280 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-10e90121-2f6f-4a58-b994-12f810115871 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:31.801887 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-10e90121-2f6f-4a58-b994-12f810115871 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: d9caf46a-f22c-4f22-ac19-8acb57190713] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:31.807868 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-10e90121-2f6f-4a58-b994-12f810115871 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:31.808308 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-10e90121-2f6f-4a58-b994-12f810115871 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:31.809057 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-10e90121-2f6f-4a58-b994-12f810115871 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:31.809482 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-10e90121-2f6f-4a58-b994-12f810115871 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:31.933980 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-10e90121-2f6f-4a58-b994-12f810115871 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8734210db2404107bb002f83f73ce02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab690ea015684fd0a5fb3fd3b162b6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:36:31.942077 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-10e90121-2f6f-4a58-b994-12f810115871 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "GET /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713" status: 200 len: 1313 microversion: 2.1 time: 0.145849 Oct 19 08:36:31.942734 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 770/1583] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:31 2021] GET /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:36:32.959153 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-df649bb4-aa96-46ee-ac71-a7cb25b563a0 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:32.959754 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-df649bb4-aa96-46ee-ac71-a7cb25b563a0 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: d9caf46a-f22c-4f22-ac19-8acb57190713] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:32.965590 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-df649bb4-aa96-46ee-ac71-a7cb25b563a0 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:32.966036 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-df649bb4-aa96-46ee-ac71-a7cb25b563a0 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:32.966813 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-df649bb4-aa96-46ee-ac71-a7cb25b563a0 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:32.967238 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-df649bb4-aa96-46ee-ac71-a7cb25b563a0 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:33.085910 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-df649bb4-aa96-46ee-ac71-a7cb25b563a0 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8734210db2404107bb002f83f73ce02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab690ea015684fd0a5fb3fd3b162b6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:36:33.093065 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-df649bb4-aa96-46ee-ac71-a7cb25b563a0 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "GET /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713" status: 200 len: 1313 microversion: 2.1 time: 0.138161 Oct 19 08:36:33.093628 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 814/1584] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:32 2021] GET /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713 => generated 1313 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:36:34.108854 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-847486a3-df23-4783-8cce-8a27fcffc767 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:34.109454 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-847486a3-df23-4783-8cce-8a27fcffc767 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: d9caf46a-f22c-4f22-ac19-8acb57190713] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:34.116129 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-847486a3-df23-4783-8cce-8a27fcffc767 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:34.116571 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-847486a3-df23-4783-8cce-8a27fcffc767 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:34.117324 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-847486a3-df23-4783-8cce-8a27fcffc767 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:34.117752 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-847486a3-df23-4783-8cce-8a27fcffc767 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:34.235100 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-847486a3-df23-4783-8cce-8a27fcffc767 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8734210db2404107bb002f83f73ce02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab690ea015684fd0a5fb3fd3b162b6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:36:34.242216 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-847486a3-df23-4783-8cce-8a27fcffc767 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "GET /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713" status: 200 len: 1313 microversion: 2.1 time: 0.137022 Oct 19 08:36:34.242809 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 771/1585] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:34 2021] GET /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713 => generated 1313 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:36:35.259121 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-aaf30ccc-f85e-4868-87b2-92722fcb5f5f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:35.259747 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-aaf30ccc-f85e-4868-87b2-92722fcb5f5f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: d9caf46a-f22c-4f22-ac19-8acb57190713] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:35.265716 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-aaf30ccc-f85e-4868-87b2-92722fcb5f5f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:35.266134 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-aaf30ccc-f85e-4868-87b2-92722fcb5f5f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:35.267177 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-aaf30ccc-f85e-4868-87b2-92722fcb5f5f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:35.267883 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-aaf30ccc-f85e-4868-87b2-92722fcb5f5f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:35.393111 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-aaf30ccc-f85e-4868-87b2-92722fcb5f5f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8734210db2404107bb002f83f73ce02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab690ea015684fd0a5fb3fd3b162b6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:36:35.402943 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-aaf30ccc-f85e-4868-87b2-92722fcb5f5f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "GET /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713" status: 200 len: 1313 microversion: 2.1 time: 0.145372 Oct 19 08:36:35.402943 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 815/1586] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:35 2021] GET /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:36:36.418296 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-92fbc7eb-8039-4e63-a677-65963bd5b5ab tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:36.418915 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-92fbc7eb-8039-4e63-a677-65963bd5b5ab tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: d9caf46a-f22c-4f22-ac19-8acb57190713] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:36.425613 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-92fbc7eb-8039-4e63-a677-65963bd5b5ab tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:36.426052 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-92fbc7eb-8039-4e63-a677-65963bd5b5ab tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:36.426857 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-92fbc7eb-8039-4e63-a677-65963bd5b5ab tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:36.427283 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-92fbc7eb-8039-4e63-a677-65963bd5b5ab tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:36.547202 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-92fbc7eb-8039-4e63-a677-65963bd5b5ab tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8734210db2404107bb002f83f73ce02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab690ea015684fd0a5fb3fd3b162b6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:36:36.554355 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-92fbc7eb-8039-4e63-a677-65963bd5b5ab tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "GET /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713" status: 200 len: 1313 microversion: 2.1 time: 0.139726 Oct 19 08:36:36.554944 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 772/1587] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:36 2021] GET /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713 => generated 1313 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:36:37.502770 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-1b0220e1-bb5b-4f1b-b84d-9d57e01adf71 req-6ec2c946-e573-4b96-a26d-b08f623cbab8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9caf46a-f22c-4f22-ac19-8acb57190713", "name": "network-vif-plugged", "status": "completed", "tag": "532adc10-dcd7-402b-83d9-f99e62b6924c"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:36:37.504395 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:36:37.504395 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:36:37.510929 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-1b0220e1-bb5b-4f1b-b84d-9d57e01adf71 req-6ec2c946-e573-4b96-a26d-b08f623cbab8 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:37.511360 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-1b0220e1-bb5b-4f1b-b84d-9d57e01adf71 req-6ec2c946-e573-4b96-a26d-b08f623cbab8 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:37.523272 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-1b0220e1-bb5b-4f1b-b84d-9d57e01adf71 req-6ec2c946-e573-4b96-a26d-b08f623cbab8 service nova] Creating event network-vif-plugged:532adc10-dcd7-402b-83d9-f99e62b6924c for instance d9caf46a-f22c-4f22-ac19-8acb57190713 on hv-cinder-81398 Oct 19 08:36:37.528205 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-1b0220e1-bb5b-4f1b-b84d-9d57e01adf71 req-6ec2c946-e573-4b96-a26d-b08f623cbab8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151336 Oct 19 08:36:37.528763 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 816/1588] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:36:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:36:37.571285 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-20442ecc-1ce0-4812-8b8b-3aec812c8ca8 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:37.572007 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-20442ecc-1ce0-4812-8b8b-3aec812c8ca8 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: d9caf46a-f22c-4f22-ac19-8acb57190713] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:37.577799 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-20442ecc-1ce0-4812-8b8b-3aec812c8ca8 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:37.578313 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-20442ecc-1ce0-4812-8b8b-3aec812c8ca8 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:37.579109 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-20442ecc-1ce0-4812-8b8b-3aec812c8ca8 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:37.579538 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-20442ecc-1ce0-4812-8b8b-3aec812c8ca8 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:37.702612 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-20442ecc-1ce0-4812-8b8b-3aec812c8ca8 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8734210db2404107bb002f83f73ce02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab690ea015684fd0a5fb3fd3b162b6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:36:37.710186 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-20442ecc-1ce0-4812-8b8b-3aec812c8ca8 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "GET /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713" status: 200 len: 1313 microversion: 2.1 time: 0.142673 Oct 19 08:36:37.710991 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 773/1589] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:37 2021] GET /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713 => generated 1313 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:36:38.727611 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-139a297c-8a36-4cbd-8c89-77380cf2b1d9 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:38.728286 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-139a297c-8a36-4cbd-8c89-77380cf2b1d9 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: d9caf46a-f22c-4f22-ac19-8acb57190713] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:38.734107 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-139a297c-8a36-4cbd-8c89-77380cf2b1d9 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:38.734568 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-139a297c-8a36-4cbd-8c89-77380cf2b1d9 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:38.735320 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-139a297c-8a36-4cbd-8c89-77380cf2b1d9 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:38.735743 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-139a297c-8a36-4cbd-8c89-77380cf2b1d9 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:38.938092 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-139a297c-8a36-4cbd-8c89-77380cf2b1d9 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8734210db2404107bb002f83f73ce02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab690ea015684fd0a5fb3fd3b162b6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:36:38.945615 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-139a297c-8a36-4cbd-8c89-77380cf2b1d9 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "GET /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713" status: 200 len: 1313 microversion: 2.1 time: 0.221961 Oct 19 08:36:38.946184 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 817/1590] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:38 2021] GET /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:36:39.291536 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-086d5075-3feb-48ab-a93a-9b9f0ad455ab tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:39.292076 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-086d5075-3feb-48ab-a93a-9b9f0ad455ab tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:39.298019 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-086d5075-3feb-48ab-a93a-9b9f0ad455ab tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:39.298524 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-086d5075-3feb-48ab-a93a-9b9f0ad455ab tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:39.299732 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-086d5075-3feb-48ab-a93a-9b9f0ad455ab tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:39.300163 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-086d5075-3feb-48ab-a93a-9b9f0ad455ab tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:39.325534 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-086d5075-3feb-48ab-a93a-9b9f0ad455ab tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Going to try to terminate instance {{(pid=114105) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 19 08:36:39.354923 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-0a83510b-0cea-454c-93a5-c0d4598c632d req-a167f519-6539-4c52-adf3-a84bd2965c50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59c3fb17-9b00-4111-afa2-59ce69f7a986", "tag": "12a0882c-425b-45ca-9a64-43ef73c77095"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:36:39.356515 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:36:39.356515 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:36:39.364274 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-0a83510b-0cea-454c-93a5-c0d4598c632d req-a167f519-6539-4c52-adf3-a84bd2965c50 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:39.364742 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-0a83510b-0cea-454c-93a5-c0d4598c632d req-a167f519-6539-4c52-adf3-a84bd2965c50 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:39.380965 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-0a83510b-0cea-454c-93a5-c0d4598c632d req-a167f519-6539-4c52-adf3-a84bd2965c50 service nova] Creating event network-changed:12a0882c-425b-45ca-9a64-43ef73c77095 for instance 59c3fb17-9b00-4111-afa2-59ce69f7a986 on hv-cinder-81398 Oct 19 08:36:39.386604 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-0a83510b-0cea-454c-93a5-c0d4598c632d req-a167f519-6539-4c52-adf3-a84bd2965c50 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091786 Oct 19 08:36:39.387438 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 818/1591] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:36:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:36:39.412959 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-086d5075-3feb-48ab-a93a-9b9f0ad455ab tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "DELETE /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 204 len: 0 microversion: 2.1 time: 0.124640 Oct 19 08:36:39.415173 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 774/1592] 10.222.0.26 () {58 vars in 1238 bytes} [Tue Oct 19 08:36:39 2021] DELETE /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 08:36:39.428101 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-772934bf-aec6-443c-884c-a0c51b159fa7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:39.428955 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-772934bf-aec6-443c-884c-a0c51b159fa7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:39.437965 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-772934bf-aec6-443c-884c-a0c51b159fa7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:39.438428 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-772934bf-aec6-443c-884c-a0c51b159fa7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:39.439517 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-772934bf-aec6-443c-884c-a0c51b159fa7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:39.440080 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-772934bf-aec6-443c-884c-a0c51b159fa7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:39.575461 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-772934bf-aec6-443c-884c-a0c51b159fa7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:36:39.586206 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-772934bf-aec6-443c-884c-a0c51b159fa7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1569 microversion: 2.1 time: 0.165007 Oct 19 08:36:39.596960 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 819/1593] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:39 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:36:39.962653 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-eadab7ff-c6dd-4636-b6ce-7394ed46b7f3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:39.963349 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-eadab7ff-c6dd-4636-b6ce-7394ed46b7f3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: d9caf46a-f22c-4f22-ac19-8acb57190713] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:39.969071 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-eadab7ff-c6dd-4636-b6ce-7394ed46b7f3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:39.969516 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-eadab7ff-c6dd-4636-b6ce-7394ed46b7f3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:39.970875 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-eadab7ff-c6dd-4636-b6ce-7394ed46b7f3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:39.971543 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-eadab7ff-c6dd-4636-b6ce-7394ed46b7f3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:40.099930 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-eadab7ff-c6dd-4636-b6ce-7394ed46b7f3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8734210db2404107bb002f83f73ce02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab690ea015684fd0a5fb3fd3b162b6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:36:40.108319 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-eadab7ff-c6dd-4636-b6ce-7394ed46b7f3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "GET /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713" status: 200 len: 1497 microversion: 2.1 time: 0.149690 Oct 19 08:36:40.108904 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 775/1594] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:39 2021] GET /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713 => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:36:40.510903 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-71199163-3303-4418-a4e1-94a20523eea3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:40.511398 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-71199163-3303-4418-a4e1-94a20523eea3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: d9caf46a-f22c-4f22-ac19-8acb57190713] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:40.519145 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-71199163-3303-4418-a4e1-94a20523eea3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:40.519585 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-71199163-3303-4418-a4e1-94a20523eea3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:40.520336 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-71199163-3303-4418-a4e1-94a20523eea3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:40.520779 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-71199163-3303-4418-a4e1-94a20523eea3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:40.544977 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-71199163-3303-4418-a4e1-94a20523eea3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: d9caf46a-f22c-4f22-ac19-8acb57190713] Going to try to terminate instance {{(pid=114106) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 19 08:36:40.605245 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c3323b07-fdb5-44bf-934d-5c539d8fdfc7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:40.605940 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-c3323b07-fdb5-44bf-934d-5c539d8fdfc7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:40.612818 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c3323b07-fdb5-44bf-934d-5c539d8fdfc7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:40.613255 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c3323b07-fdb5-44bf-934d-5c539d8fdfc7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:40.614608 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c3323b07-fdb5-44bf-934d-5c539d8fdfc7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:40.615038 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c3323b07-fdb5-44bf-934d-5c539d8fdfc7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:40.620268 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-71199163-3303-4418-a4e1-94a20523eea3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713" status: 204 len: 0 microversion: 2.1 time: 0.112754 Oct 19 08:36:40.621031 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 820/1595] 10.222.0.26 () {58 vars in 1238 bytes} [Tue Oct 19 08:36:40 2021] DELETE /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 08:36:40.630201 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-276edb89-e8b6-43b4-9145-0e6e36431187 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:40.630914 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-276edb89-e8b6-43b4-9145-0e6e36431187 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: d9caf46a-f22c-4f22-ac19-8acb57190713] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:40.636662 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-276edb89-e8b6-43b4-9145-0e6e36431187 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:40.637106 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-276edb89-e8b6-43b4-9145-0e6e36431187 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:40.637996 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-276edb89-e8b6-43b4-9145-0e6e36431187 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:40.638426 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-276edb89-e8b6-43b4-9145-0e6e36431187 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:40.801353 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-c3323b07-fdb5-44bf-934d-5c539d8fdfc7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:36:40.804263 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-276edb89-e8b6-43b4-9145-0e6e36431187 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8734210db2404107bb002f83f73ce02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab690ea015684fd0a5fb3fd3b162b6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:36:40.808798 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-c3323b07-fdb5-44bf-934d-5c539d8fdfc7 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1451 microversion: 2.1 time: 0.208264 Oct 19 08:36:40.809435 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 776/1596] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:40 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1451 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:36:40.811714 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-276edb89-e8b6-43b4-9145-0e6e36431187 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "GET /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713" status: 200 len: 1503 microversion: 2.1 time: 0.186608 Oct 19 08:36:40.812264 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 821/1597] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:40 2021] GET /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713 => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:36:41.623120 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-7cc70b09-73f0-4236-9368-e56f315b0eef req-a6ccf764-a08c-42e9-af3c-fc2f901dd3bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59c3fb17-9b00-4111-afa2-59ce69f7a986", "name": "network-vif-deleted", "tag": "12a0882c-425b-45ca-9a64-43ef73c77095"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:36:41.624696 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:36:41.624696 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:36:41.631798 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-7cc70b09-73f0-4236-9368-e56f315b0eef req-a6ccf764-a08c-42e9-af3c-fc2f901dd3bb service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:41.632236 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-7cc70b09-73f0-4236-9368-e56f315b0eef req-a6ccf764-a08c-42e9-af3c-fc2f901dd3bb service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:41.643592 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-7cc70b09-73f0-4236-9368-e56f315b0eef req-a6ccf764-a08c-42e9-af3c-fc2f901dd3bb service nova] Creating event network-vif-deleted:12a0882c-425b-45ca-9a64-43ef73c77095 for instance 59c3fb17-9b00-4111-afa2-59ce69f7a986 on hv-cinder-81398 Oct 19 08:36:41.648430 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-7cc70b09-73f0-4236-9368-e56f315b0eef req-a6ccf764-a08c-42e9-af3c-fc2f901dd3bb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028900 Oct 19 08:36:41.649047 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 777/1598] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:36:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:36:41.827333 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-68fda181-bec9-4ce9-a38d-f06c9669aa36 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:41.828419 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-68fda181-bec9-4ce9-a38d-f06c9669aa36 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:41.829553 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-9b79e8ae-38d4-45b0-a97c-941c01dd49e2 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:41.830778 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-9b79e8ae-38d4-45b0-a97c-941c01dd49e2 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: d9caf46a-f22c-4f22-ac19-8acb57190713] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:41.836559 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-68fda181-bec9-4ce9-a38d-f06c9669aa36 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:41.836959 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-68fda181-bec9-4ce9-a38d-f06c9669aa36 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:41.837238 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9b79e8ae-38d4-45b0-a97c-941c01dd49e2 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:41.837739 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9b79e8ae-38d4-45b0-a97c-941c01dd49e2 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:41.837917 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-68fda181-bec9-4ce9-a38d-f06c9669aa36 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:41.838295 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-68fda181-bec9-4ce9-a38d-f06c9669aa36 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:41.839295 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9b79e8ae-38d4-45b0-a97c-941c01dd49e2 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:41.839295 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9b79e8ae-38d4-45b0-a97c-941c01dd49e2 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:41.923606 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-68fda181-bec9-4ce9-a38d-f06c9669aa36 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd215d02d64fc47ae988b63aca21203a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c35a609df154c65988d39d98e9f50c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:36:41.937374 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-68fda181-bec9-4ce9-a38d-f06c9669aa36 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 200 len: 1219 microversion: 2.1 time: 0.114369 Oct 19 08:36:41.947494 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 822/1599] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:41 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 1219 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:36:42.019621 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-9b79e8ae-38d4-45b0-a97c-941c01dd49e2 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8734210db2404107bb002f83f73ce02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab690ea015684fd0a5fb3fd3b162b6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:36:42.027588 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-9b79e8ae-38d4-45b0-a97c-941c01dd49e2 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "GET /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713" status: 200 len: 1503 microversion: 2.1 time: 0.201869 Oct 19 08:36:42.028167 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 778/1600] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:41 2021] GET /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713 => generated 1503 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:36:42.954414 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-674740be-fbee-43f7-a90d-3439bea8075e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:42.955193 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-674740be-fbee-43f7-a90d-3439bea8075e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] [instance: 59c3fb17-9b00-4111-afa2-59ce69f7a986] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:42.960937 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-674740be-fbee-43f7-a90d-3439bea8075e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:42.961381 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-674740be-fbee-43f7-a90d-3439bea8075e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:42.962145 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-674740be-fbee-43f7-a90d-3439bea8075e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:42.962602 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-674740be-fbee-43f7-a90d-3439bea8075e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:42.976197 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.wsgi [None req-674740be-fbee-43f7-a90d-3439bea8075e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] HTTP exception thrown: Instance 59c3fb17-9b00-4111-afa2-59ce69f7a986 could not be found. Oct 19 08:36:42.976781 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-674740be-fbee-43f7-a90d-3439bea8075e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Returning 404 to user: Instance 59c3fb17-9b00-4111-afa2-59ce69f7a986 could not be found. {{(pid=114106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:36:42.977582 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-674740be-fbee-43f7-a90d-3439bea8075e tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986" status: 404 len: 111 microversion: 2.1 time: 0.027020 Oct 19 08:36:42.978104 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 823/1601] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:42 2021] GET /compute/v2.1/servers/59c3fb17-9b00-4111-afa2-59ce69f7a986 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:36:43.044890 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-21e96cde-7849-4a1d-b004-c66b7d7a8028 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:43.045591 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-21e96cde-7849-4a1d-b004-c66b7d7a8028 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: d9caf46a-f22c-4f22-ac19-8acb57190713] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:43.052232 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-21e96cde-7849-4a1d-b004-c66b7d7a8028 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:43.052676 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-21e96cde-7849-4a1d-b004-c66b7d7a8028 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:43.053450 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-21e96cde-7849-4a1d-b004-c66b7d7a8028 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:43.053879 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-21e96cde-7849-4a1d-b004-c66b7d7a8028 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:43.083292 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-21e96cde-7849-4a1d-b004-c66b7d7a8028 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:43.083735 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-21e96cde-7849-4a1d-b004-c66b7d7a8028 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:43.084178 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.objects.instance [None req-21e96cde-7849-4a1d-b004-c66b7d7a8028 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lazy-loading 'fault' on Instance uuid d9caf46a-f22c-4f22-ac19-8acb57190713 {{(pid=114105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 19 08:36:43.124372 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-21e96cde-7849-4a1d-b004-c66b7d7a8028 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8734210db2404107bb002f83f73ce02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab690ea015684fd0a5fb3fd3b162b6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:36:43.132382 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-21e96cde-7849-4a1d-b004-c66b7d7a8028 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "GET /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713" status: 200 len: 1303 microversion: 2.1 time: 0.091168 Oct 19 08:36:43.139630 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-78644842-9fe4-4389-8335-c373bb6a4442 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] Calling method '.version_select at 0x7fcadda01700>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:43.142836 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 779/1602] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:43 2021] GET /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713 => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:36:43.163975 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-78644842-9fe4-4389-8335-c373bb6a4442 tempest-TestShelveInstance-136316270 tempest-TestShelveInstance-136316270-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-118533541" status: 202 len: 0 microversion: 2.1 time: 0.028355 Oct 19 08:36:43.168561 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 824/1603] 10.222.0.26 () {58 vars in 1250 bytes} [Tue Oct 19 08:36:43 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-118533541 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:36:43.667186 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-e359ce3d-2a95-4a19-a497-8f0abc264a38 req-76ff5b77-53c2-4c7f-b38c-745afcbd7452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9caf46a-f22c-4f22-ac19-8acb57190713", "name": "network-vif-deleted", "tag": "532adc10-dcd7-402b-83d9-f99e62b6924c"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:36:43.668715 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:36:43.668715 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:36:43.675613 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-e359ce3d-2a95-4a19-a497-8f0abc264a38 req-76ff5b77-53c2-4c7f-b38c-745afcbd7452 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:43.676052 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-e359ce3d-2a95-4a19-a497-8f0abc264a38 req-76ff5b77-53c2-4c7f-b38c-745afcbd7452 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:43.686756 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-e359ce3d-2a95-4a19-a497-8f0abc264a38 req-76ff5b77-53c2-4c7f-b38c-745afcbd7452 service nova] Creating event network-vif-deleted:532adc10-dcd7-402b-83d9-f99e62b6924c for instance d9caf46a-f22c-4f22-ac19-8acb57190713 on hv-cinder-81398 Oct 19 08:36:43.692241 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-e359ce3d-2a95-4a19-a497-8f0abc264a38 req-76ff5b77-53c2-4c7f-b38c-745afcbd7452 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028752 Oct 19 08:36:43.692813 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 780/1604] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:36:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:36:44.149092 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-78bfe0e3-596b-4325-92cc-0aeb3f4d1ab3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:44.150332 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-78bfe0e3-596b-4325-92cc-0aeb3f4d1ab3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: d9caf46a-f22c-4f22-ac19-8acb57190713] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:44.157296 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-78bfe0e3-596b-4325-92cc-0aeb3f4d1ab3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:44.157773 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-78bfe0e3-596b-4325-92cc-0aeb3f4d1ab3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:44.158582 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-78bfe0e3-596b-4325-92cc-0aeb3f4d1ab3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:44.159016 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-78bfe0e3-596b-4325-92cc-0aeb3f4d1ab3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:44.173827 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.wsgi [None req-78bfe0e3-596b-4325-92cc-0aeb3f4d1ab3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] HTTP exception thrown: Instance d9caf46a-f22c-4f22-ac19-8acb57190713 could not be found. Oct 19 08:36:44.174996 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-78bfe0e3-596b-4325-92cc-0aeb3f4d1ab3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Returning 404 to user: Instance d9caf46a-f22c-4f22-ac19-8acb57190713 could not be found. {{(pid=114106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:36:44.176115 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-78bfe0e3-596b-4325-92cc-0aeb3f4d1ab3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "GET /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713" status: 404 len: 111 microversion: 2.1 time: 0.030837 Oct 19 08:36:44.176902 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 825/1605] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:44 2021] GET /compute/v2.1/servers/d9caf46a-f22c-4f22-ac19-8acb57190713 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:36:44.229118 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-a45e3fcc-7e23-4483-9120-83b2820652c3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-634175424", "imageRef": "9102a998-a580-4b4e-b6a1-3172273dd66d", "flavorRef": "452", "networks": [{"uuid": "99f587ad-50a2-4763-8d6f-46d8c355845a"}]}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:36:44.284537 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.network.neutron [None req-a45e3fcc-7e23-4483-9120-83b2820652c3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] validate_networks() for [('99f587ad-50a2-4763-8d6f-46d8c355845a', None, None, None, None, None)] {{(pid=114105) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 19 08:36:44.639480 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-a45e3fcc-7e23-4483-9120-83b2820652c3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Flavor limits 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 08:36:44.639904 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-a45e3fcc-7e23-4483-9120-83b2820652c3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Image limits 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 08:36:44.640376 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-a45e3fcc-7e23-4483-9120-83b2820652c3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Flavor pref 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 08:36:44.640849 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-a45e3fcc-7e23-4483-9120-83b2820652c3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Image pref 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 08:36:44.641267 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-a45e3fcc-7e23-4483-9120-83b2820652c3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 08:36:44.650935 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a45e3fcc-7e23-4483-9120-83b2820652c3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:44.651447 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a45e3fcc-7e23-4483-9120-83b2820652c3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:44.652254 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a45e3fcc-7e23-4483-9120-83b2820652c3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:44.652688 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a45e3fcc-7e23-4483-9120-83b2820652c3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:44.669514 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-a45e3fcc-7e23-4483-9120-83b2820652c3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Getting quotas for project ab690ea015684fd0a5fb3fd3b162b6a7. Resources: {'cores', 'instances', 'ram'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:36:44.674406 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-a45e3fcc-7e23-4483-9120-83b2820652c3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Getting quotas for user 8734210db2404107bb002f83f73ce02f and project ab690ea015684fd0a5fb3fd3b162b6a7. Resources: {'cores', 'instances', 'ram'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:36:44.687754 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-a45e3fcc-7e23-4483-9120-83b2820652c3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Going to run 1 instances... {{(pid=114105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 19 08:36:44.690244 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-a45e3fcc-7e23-4483-9120-83b2820652c3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: 1aed19ab-e848-44c3-ad4f-2221f4f4a860] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9102a998-a580-4b4e-b6a1-3172273dd66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 19 08:36:44.739000 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-a45e3fcc-7e23-4483-9120-83b2820652c3 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.514298 Oct 19 08:36:44.744572 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 781/1606] 10.222.0.26 () {60 vars in 1146 bytes} [Tue Oct 19 08:36:44 2021] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 08:36:44.749174 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-402759bf-f5a6-4d61-beba-47ce9514e00e tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:44.750276 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-402759bf-f5a6-4d61-beba-47ce9514e00e tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: 1aed19ab-e848-44c3-ad4f-2221f4f4a860] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:44.817564 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-402759bf-f5a6-4d61-beba-47ce9514e00e tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8734210db2404107bb002f83f73ce02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab690ea015684fd0a5fb3fd3b162b6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:36:44.826356 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-402759bf-f5a6-4d61-beba-47ce9514e00e tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "GET /compute/v2.1/servers/1aed19ab-e848-44c3-ad4f-2221f4f4a860" status: 200 len: 1213 microversion: 2.1 time: 0.080390 Oct 19 08:36:44.826955 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 826/1607] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:44 2021] GET /compute/v2.1/servers/1aed19ab-e848-44c3-ad4f-2221f4f4a860 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:36:45.843835 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-209c22f6-72ed-4550-a648-07505eee41ae tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:45.845121 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-209c22f6-72ed-4550-a648-07505eee41ae tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: 1aed19ab-e848-44c3-ad4f-2221f4f4a860] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:45.854738 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-209c22f6-72ed-4550-a648-07505eee41ae tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:45.855597 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-209c22f6-72ed-4550-a648-07505eee41ae tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:45.857732 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-209c22f6-72ed-4550-a648-07505eee41ae tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:45.858312 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-209c22f6-72ed-4550-a648-07505eee41ae tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:45.956123 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-209c22f6-72ed-4550-a648-07505eee41ae tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8734210db2404107bb002f83f73ce02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab690ea015684fd0a5fb3fd3b162b6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:36:45.978792 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-209c22f6-72ed-4550-a648-07505eee41ae tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "GET /compute/v2.1/servers/1aed19ab-e848-44c3-ad4f-2221f4f4a860" status: 200 len: 1271 microversion: 2.1 time: 0.137656 Oct 19 08:36:45.991932 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 782/1608] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:45 2021] GET /compute/v2.1/servers/1aed19ab-e848-44c3-ad4f-2221f4f4a860 => generated 1271 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:36:46.995922 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-52b7e602-da08-4d44-aeee-e69ecdef455f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:46.997123 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-52b7e602-da08-4d44-aeee-e69ecdef455f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: 1aed19ab-e848-44c3-ad4f-2221f4f4a860] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:47.002924 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-52b7e602-da08-4d44-aeee-e69ecdef455f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:47.003598 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-52b7e602-da08-4d44-aeee-e69ecdef455f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:47.004367 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-52b7e602-da08-4d44-aeee-e69ecdef455f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:47.004791 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-52b7e602-da08-4d44-aeee-e69ecdef455f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:47.106244 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-f7cbfedd-15a6-45e0-909b-92fb5bc1aad7 req-73cd24c2-312e-4f58-b104-e3f6ae06a5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aed19ab-e848-44c3-ad4f-2221f4f4a860", "tag": "8db49dd2-9f49-4165-bb98-9f00d66cff2d"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:36:47.109071 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:36:47.109071 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:36:47.118331 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-f7cbfedd-15a6-45e0-909b-92fb5bc1aad7 req-73cd24c2-312e-4f58-b104-e3f6ae06a5f1 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:47.118924 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-f7cbfedd-15a6-45e0-909b-92fb5bc1aad7 req-73cd24c2-312e-4f58-b104-e3f6ae06a5f1 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:47.139654 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-f7cbfedd-15a6-45e0-909b-92fb5bc1aad7 req-73cd24c2-312e-4f58-b104-e3f6ae06a5f1 service nova] Creating event network-changed:8db49dd2-9f49-4165-bb98-9f00d66cff2d for instance 1aed19ab-e848-44c3-ad4f-2221f4f4a860 on hv-cinder-81398 Oct 19 08:36:47.145417 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-f7cbfedd-15a6-45e0-909b-92fb5bc1aad7 req-73cd24c2-312e-4f58-b104-e3f6ae06a5f1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042877 Oct 19 08:36:47.146373 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 783/1609] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:36:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:36:47.243292 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-52b7e602-da08-4d44-aeee-e69ecdef455f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8734210db2404107bb002f83f73ce02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab690ea015684fd0a5fb3fd3b162b6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:36:47.254475 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-52b7e602-da08-4d44-aeee-e69ecdef455f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "GET /compute/v2.1/servers/1aed19ab-e848-44c3-ad4f-2221f4f4a860" status: 200 len: 1313 microversion: 2.1 time: 0.262149 Oct 19 08:36:47.255408 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 827/1610] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:46 2021] GET /compute/v2.1/servers/1aed19ab-e848-44c3-ad4f-2221f4f4a860 => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:36:48.272312 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-8b5b3d0e-ec94-4bf4-8c34-2db5a468b8dc tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:48.273616 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-8b5b3d0e-ec94-4bf4-8c34-2db5a468b8dc tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: 1aed19ab-e848-44c3-ad4f-2221f4f4a860] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:48.279766 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8b5b3d0e-ec94-4bf4-8c34-2db5a468b8dc tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:48.280430 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8b5b3d0e-ec94-4bf4-8c34-2db5a468b8dc tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:48.281185 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8b5b3d0e-ec94-4bf4-8c34-2db5a468b8dc tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:48.281776 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-8b5b3d0e-ec94-4bf4-8c34-2db5a468b8dc tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:48.445883 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-8b5b3d0e-ec94-4bf4-8c34-2db5a468b8dc tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8734210db2404107bb002f83f73ce02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab690ea015684fd0a5fb3fd3b162b6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:36:48.453582 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-8b5b3d0e-ec94-4bf4-8c34-2db5a468b8dc tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "GET /compute/v2.1/servers/1aed19ab-e848-44c3-ad4f-2221f4f4a860" status: 200 len: 1313 microversion: 2.1 time: 0.185257 Oct 19 08:36:48.459416 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 784/1611] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:48 2021] GET /compute/v2.1/servers/1aed19ab-e848-44c3-ad4f-2221f4f4a860 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:36:49.472976 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-5e1e52d5-912d-4f08-b3a7-07f96f48e3dc tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:49.473651 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-5e1e52d5-912d-4f08-b3a7-07f96f48e3dc tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: 1aed19ab-e848-44c3-ad4f-2221f4f4a860] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:49.479353 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5e1e52d5-912d-4f08-b3a7-07f96f48e3dc tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:49.479989 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5e1e52d5-912d-4f08-b3a7-07f96f48e3dc tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:49.480755 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5e1e52d5-912d-4f08-b3a7-07f96f48e3dc tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:49.481183 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-5e1e52d5-912d-4f08-b3a7-07f96f48e3dc tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:49.727791 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-5e1e52d5-912d-4f08-b3a7-07f96f48e3dc tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8734210db2404107bb002f83f73ce02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab690ea015684fd0a5fb3fd3b162b6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:36:49.735989 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-5e1e52d5-912d-4f08-b3a7-07f96f48e3dc tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "GET /compute/v2.1/servers/1aed19ab-e848-44c3-ad4f-2221f4f4a860" status: 200 len: 1313 microversion: 2.1 time: 0.266612 Oct 19 08:36:49.737081 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 828/1612] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:49 2021] GET /compute/v2.1/servers/1aed19ab-e848-44c3-ad4f-2221f4f4a860 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:36:50.754566 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-12377f63-96aa-4863-b162-457808685c9f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:50.755173 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-12377f63-96aa-4863-b162-457808685c9f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: 1aed19ab-e848-44c3-ad4f-2221f4f4a860] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:50.761954 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-12377f63-96aa-4863-b162-457808685c9f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:50.762394 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-12377f63-96aa-4863-b162-457808685c9f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:50.763214 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-12377f63-96aa-4863-b162-457808685c9f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:50.763660 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-12377f63-96aa-4863-b162-457808685c9f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:50.896537 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-12377f63-96aa-4863-b162-457808685c9f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8734210db2404107bb002f83f73ce02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab690ea015684fd0a5fb3fd3b162b6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:36:50.904136 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-12377f63-96aa-4863-b162-457808685c9f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "GET /compute/v2.1/servers/1aed19ab-e848-44c3-ad4f-2221f4f4a860" status: 200 len: 1313 microversion: 2.1 time: 0.154635 Oct 19 08:36:50.904732 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 785/1613] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:50 2021] GET /compute/v2.1/servers/1aed19ab-e848-44c3-ad4f-2221f4f4a860 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:36:51.920844 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-46ab7512-e0c7-4ff1-bc45-1e3117fd9575 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:51.921444 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-46ab7512-e0c7-4ff1-bc45-1e3117fd9575 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: 1aed19ab-e848-44c3-ad4f-2221f4f4a860] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:51.927788 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-46ab7512-e0c7-4ff1-bc45-1e3117fd9575 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:51.928020 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-46ab7512-e0c7-4ff1-bc45-1e3117fd9575 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:51.928809 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-46ab7512-e0c7-4ff1-bc45-1e3117fd9575 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:51.929329 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-46ab7512-e0c7-4ff1-bc45-1e3117fd9575 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:52.050137 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-46ab7512-e0c7-4ff1-bc45-1e3117fd9575 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8734210db2404107bb002f83f73ce02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab690ea015684fd0a5fb3fd3b162b6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:36:52.057413 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-46ab7512-e0c7-4ff1-bc45-1e3117fd9575 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "GET /compute/v2.1/servers/1aed19ab-e848-44c3-ad4f-2221f4f4a860" status: 200 len: 1313 microversion: 2.1 time: 0.140314 Oct 19 08:36:52.057965 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 829/1614] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:51 2021] GET /compute/v2.1/servers/1aed19ab-e848-44c3-ad4f-2221f4f4a860 => generated 1313 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:36:53.074505 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-3d2e4d81-b112-468c-ad63-29e96aab4a52 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:53.075109 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-3d2e4d81-b112-468c-ad63-29e96aab4a52 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: 1aed19ab-e848-44c3-ad4f-2221f4f4a860] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:53.081131 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3d2e4d81-b112-468c-ad63-29e96aab4a52 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:53.081574 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3d2e4d81-b112-468c-ad63-29e96aab4a52 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:53.082336 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3d2e4d81-b112-468c-ad63-29e96aab4a52 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:53.082856 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-3d2e4d81-b112-468c-ad63-29e96aab4a52 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:53.202512 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-3d2e4d81-b112-468c-ad63-29e96aab4a52 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8734210db2404107bb002f83f73ce02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab690ea015684fd0a5fb3fd3b162b6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:36:53.209641 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-3d2e4d81-b112-468c-ad63-29e96aab4a52 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "GET /compute/v2.1/servers/1aed19ab-e848-44c3-ad4f-2221f4f4a860" status: 200 len: 1313 microversion: 2.1 time: 0.138840 Oct 19 08:36:53.210193 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 786/1615] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:53 2021] GET /compute/v2.1/servers/1aed19ab-e848-44c3-ad4f-2221f4f4a860 => generated 1313 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:36:53.464390 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-aaa980cf-bacc-4d7b-b1fa-260bef1883f9 req-fcdbae1e-6b36-43ec-a277-2aa11371601b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aed19ab-e848-44c3-ad4f-2221f4f4a860", "name": "network-vif-plugged", "status": "completed", "tag": "8db49dd2-9f49-4165-bb98-9f00d66cff2d"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:36:53.465943 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:36:53.465943 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:36:53.474396 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-aaa980cf-bacc-4d7b-b1fa-260bef1883f9 req-fcdbae1e-6b36-43ec-a277-2aa11371601b service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:53.474869 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-aaa980cf-bacc-4d7b-b1fa-260bef1883f9 req-fcdbae1e-6b36-43ec-a277-2aa11371601b service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:53.486774 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-aaa980cf-bacc-4d7b-b1fa-260bef1883f9 req-fcdbae1e-6b36-43ec-a277-2aa11371601b service nova] Creating event network-vif-plugged:8db49dd2-9f49-4165-bb98-9f00d66cff2d for instance 1aed19ab-e848-44c3-ad4f-2221f4f4a860 on hv-cinder-81398 Oct 19 08:36:53.491753 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-aaa980cf-bacc-4d7b-b1fa-260bef1883f9 req-fcdbae1e-6b36-43ec-a277-2aa11371601b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031525 Oct 19 08:36:53.492337 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 830/1616] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:36:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:36:54.227919 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-c0f1d4ab-77d8-4f7c-a7be-4037608045ff tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:54.228556 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-c0f1d4ab-77d8-4f7c-a7be-4037608045ff tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: 1aed19ab-e848-44c3-ad4f-2221f4f4a860] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:54.236678 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c0f1d4ab-77d8-4f7c-a7be-4037608045ff tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:54.237134 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c0f1d4ab-77d8-4f7c-a7be-4037608045ff tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:54.237904 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c0f1d4ab-77d8-4f7c-a7be-4037608045ff tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:54.238336 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-c0f1d4ab-77d8-4f7c-a7be-4037608045ff tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:54.355985 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-c0f1d4ab-77d8-4f7c-a7be-4037608045ff tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8734210db2404107bb002f83f73ce02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab690ea015684fd0a5fb3fd3b162b6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:36:54.364302 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-c0f1d4ab-77d8-4f7c-a7be-4037608045ff tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "GET /compute/v2.1/servers/1aed19ab-e848-44c3-ad4f-2221f4f4a860" status: 200 len: 1313 microversion: 2.1 time: 0.141112 Oct 19 08:36:54.365149 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 787/1617] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:54 2021] GET /compute/v2.1/servers/1aed19ab-e848-44c3-ad4f-2221f4f4a860 => generated 1313 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:36:55.382019 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-71a1ddc9-3f20-48ac-8a6e-dc76ccbe0dfb tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:55.382730 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-71a1ddc9-3f20-48ac-8a6e-dc76ccbe0dfb tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: 1aed19ab-e848-44c3-ad4f-2221f4f4a860] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:55.388743 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-71a1ddc9-3f20-48ac-8a6e-dc76ccbe0dfb tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:55.389120 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-71a1ddc9-3f20-48ac-8a6e-dc76ccbe0dfb tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:55.389870 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-71a1ddc9-3f20-48ac-8a6e-dc76ccbe0dfb tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:55.390295 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-71a1ddc9-3f20-48ac-8a6e-dc76ccbe0dfb tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:55.509226 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-71a1ddc9-3f20-48ac-8a6e-dc76ccbe0dfb tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8734210db2404107bb002f83f73ce02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab690ea015684fd0a5fb3fd3b162b6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:36:55.516326 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-71a1ddc9-3f20-48ac-8a6e-dc76ccbe0dfb tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "GET /compute/v2.1/servers/1aed19ab-e848-44c3-ad4f-2221f4f4a860" status: 200 len: 1496 microversion: 2.1 time: 0.138373 Oct 19 08:36:55.517190 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 831/1618] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:55 2021] GET /compute/v2.1/servers/1aed19ab-e848-44c3-ad4f-2221f4f4a860 => generated 1496 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:36:55.922147 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2389e246-30eb-4cd2-a452-2a778c81719f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:55.922668 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2389e246-30eb-4cd2-a452-2a778c81719f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: 1aed19ab-e848-44c3-ad4f-2221f4f4a860] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:55.928546 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2389e246-30eb-4cd2-a452-2a778c81719f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:55.929035 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2389e246-30eb-4cd2-a452-2a778c81719f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:55.929795 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2389e246-30eb-4cd2-a452-2a778c81719f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:55.930228 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2389e246-30eb-4cd2-a452-2a778c81719f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:55.955560 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2389e246-30eb-4cd2-a452-2a778c81719f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: 1aed19ab-e848-44c3-ad4f-2221f4f4a860] Going to try to terminate instance {{(pid=114105) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 19 08:36:56.027029 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2389e246-30eb-4cd2-a452-2a778c81719f tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1aed19ab-e848-44c3-ad4f-2221f4f4a860" status: 204 len: 0 microversion: 2.1 time: 0.108067 Oct 19 08:36:56.027681 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 788/1619] 10.222.0.26 () {58 vars in 1238 bytes} [Tue Oct 19 08:36:55 2021] DELETE /compute/v2.1/servers/1aed19ab-e848-44c3-ad4f-2221f4f4a860 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 08:36:56.036356 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-6fd29621-ca08-4456-b836-b56d9da83a85 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:56.036961 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-6fd29621-ca08-4456-b836-b56d9da83a85 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: 1aed19ab-e848-44c3-ad4f-2221f4f4a860] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:56.042648 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6fd29621-ca08-4456-b836-b56d9da83a85 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:56.043092 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6fd29621-ca08-4456-b836-b56d9da83a85 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:56.043843 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6fd29621-ca08-4456-b836-b56d9da83a85 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:56.044268 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-6fd29621-ca08-4456-b836-b56d9da83a85 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:56.165301 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-6fd29621-ca08-4456-b836-b56d9da83a85 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8734210db2404107bb002f83f73ce02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab690ea015684fd0a5fb3fd3b162b6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:36:56.172594 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-6fd29621-ca08-4456-b836-b56d9da83a85 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "GET /compute/v2.1/servers/1aed19ab-e848-44c3-ad4f-2221f4f4a860" status: 200 len: 1502 microversion: 2.1 time: 0.140078 Oct 19 08:36:56.173152 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 832/1620] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:56 2021] GET /compute/v2.1/servers/1aed19ab-e848-44c3-ad4f-2221f4f4a860 => generated 1502 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:36:57.190840 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-21df247a-023c-488d-ac1e-cd32712551ac tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:57.191527 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-21df247a-023c-488d-ac1e-cd32712551ac tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: 1aed19ab-e848-44c3-ad4f-2221f4f4a860] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:57.197431 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-21df247a-023c-488d-ac1e-cd32712551ac tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:57.197869 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-21df247a-023c-488d-ac1e-cd32712551ac tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:57.198653 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-21df247a-023c-488d-ac1e-cd32712551ac tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:57.199081 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-21df247a-023c-488d-ac1e-cd32712551ac tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:57.318617 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-21df247a-023c-488d-ac1e-cd32712551ac tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8734210db2404107bb002f83f73ce02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab690ea015684fd0a5fb3fd3b162b6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:36:57.325764 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-21df247a-023c-488d-ac1e-cd32712551ac tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "GET /compute/v2.1/servers/1aed19ab-e848-44c3-ad4f-2221f4f4a860" status: 200 len: 1502 microversion: 2.1 time: 0.139147 Oct 19 08:36:57.326320 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 789/1621] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:57 2021] GET /compute/v2.1/servers/1aed19ab-e848-44c3-ad4f-2221f4f4a860 => generated 1502 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:36:58.343370 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-b397a05e-98aa-4be5-8ffb-26148fe9eed2 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:58.344019 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-b397a05e-98aa-4be5-8ffb-26148fe9eed2 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: 1aed19ab-e848-44c3-ad4f-2221f4f4a860] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:58.350483 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b397a05e-98aa-4be5-8ffb-26148fe9eed2 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:58.350964 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b397a05e-98aa-4be5-8ffb-26148fe9eed2 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:58.351705 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b397a05e-98aa-4be5-8ffb-26148fe9eed2 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:58.352125 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b397a05e-98aa-4be5-8ffb-26148fe9eed2 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:58.377383 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-656d2e91-9002-47df-b750-3d56e9231485 req-cf1df026-145b-464e-8a8d-19c4930ef7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aed19ab-e848-44c3-ad4f-2221f4f4a860", "name": "network-vif-deleted", "tag": "8db49dd2-9f49-4165-bb98-9f00d66cff2d"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:36:58.379065 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:36:58.379065 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:36:58.383332 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b397a05e-98aa-4be5-8ffb-26148fe9eed2 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:58.383895 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-b397a05e-98aa-4be5-8ffb-26148fe9eed2 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:58.384209 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.objects.instance [None req-b397a05e-98aa-4be5-8ffb-26148fe9eed2 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lazy-loading 'fault' on Instance uuid 1aed19ab-e848-44c3-ad4f-2221f4f4a860 {{(pid=114105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 19 08:36:58.386429 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-656d2e91-9002-47df-b750-3d56e9231485 req-cf1df026-145b-464e-8a8d-19c4930ef7d6 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:58.386875 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-656d2e91-9002-47df-b750-3d56e9231485 req-cf1df026-145b-464e-8a8d-19c4930ef7d6 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:58.398334 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-656d2e91-9002-47df-b750-3d56e9231485 req-cf1df026-145b-464e-8a8d-19c4930ef7d6 service nova] Creating event network-vif-deleted:8db49dd2-9f49-4165-bb98-9f00d66cff2d for instance 1aed19ab-e848-44c3-ad4f-2221f4f4a860 on hv-cinder-81398 Oct 19 08:36:58.403478 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-656d2e91-9002-47df-b750-3d56e9231485 req-cf1df026-145b-464e-8a8d-19c4930ef7d6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206500 Oct 19 08:36:58.404234 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 833/1622] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:36:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:36:58.425288 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-b397a05e-98aa-4be5-8ffb-26148fe9eed2 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8734210db2404107bb002f83f73ce02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab690ea015684fd0a5fb3fd3b162b6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:36:58.432467 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-b397a05e-98aa-4be5-8ffb-26148fe9eed2 tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "GET /compute/v2.1/servers/1aed19ab-e848-44c3-ad4f-2221f4f4a860" status: 200 len: 1303 microversion: 2.1 time: 0.092784 Oct 19 08:36:58.433016 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 790/1623] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:58 2021] GET /compute/v2.1/servers/1aed19ab-e848-44c3-ad4f-2221f4f4a860 => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:36:59.449854 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-499b28f8-58f8-46ba-a32c-a1df2c913e8e tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:36:59.450568 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-499b28f8-58f8-46ba-a32c-a1df2c913e8e tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] [instance: 1aed19ab-e848-44c3-ad4f-2221f4f4a860] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:36:59.457282 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-499b28f8-58f8-46ba-a32c-a1df2c913e8e tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:59.457722 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-499b28f8-58f8-46ba-a32c-a1df2c913e8e tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:59.458477 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-499b28f8-58f8-46ba-a32c-a1df2c913e8e tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:36:59.458931 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-499b28f8-58f8-46ba-a32c-a1df2c913e8e tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:36:59.471964 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.wsgi [None req-499b28f8-58f8-46ba-a32c-a1df2c913e8e tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] HTTP exception thrown: Instance 1aed19ab-e848-44c3-ad4f-2221f4f4a860 could not be found. Oct 19 08:36:59.472544 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-499b28f8-58f8-46ba-a32c-a1df2c913e8e tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] Returning 404 to user: Instance 1aed19ab-e848-44c3-ad4f-2221f4f4a860 could not be found. {{(pid=114106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:36:59.473343 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-499b28f8-58f8-46ba-a32c-a1df2c913e8e tempest-VolumesActionsTest-730949706 tempest-VolumesActionsTest-730949706-project] 10.222.0.26 "GET /compute/v2.1/servers/1aed19ab-e848-44c3-ad4f-2221f4f4a860" status: 404 len: 111 microversion: 2.1 time: 0.027610 Oct 19 08:36:59.473863 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 834/1624] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:36:59 2021] GET /compute/v2.1/servers/1aed19ab-e848-44c3-ad4f-2221f4f4a860 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:37:24.871004 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-f4839021-304f-410c-beff-09aa89a3603b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-250640104", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-200438871", "security_groups": [{"name": "tempest-secgroup-smoke-740896653"}], "block_device_mapping_v2": [{"uuid": "6d6f4bd3-1d2b-4758-b221-c4e4e7ac1c74", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "09e1e2e2-02ec-4078-9b6b-9e1d757336b7"}]}} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:37:24.972096 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.network.neutron [None req-f4839021-304f-410c-beff-09aa89a3603b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] validate_networks() for [('09e1e2e2-02ec-4078-9b6b-9e1d757336b7', None, None, None, None, None)] {{(pid=114105) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 19 08:37:25.352330 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-f4839021-304f-410c-beff-09aa89a3603b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Flavor limits 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 08:37:25.352743 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-f4839021-304f-410c-beff-09aa89a3603b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Image limits 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 08:37:25.353212 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-f4839021-304f-410c-beff-09aa89a3603b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Flavor pref 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 08:37:25.353611 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-f4839021-304f-410c-beff-09aa89a3603b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Image pref 0:0:0 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 08:37:25.354018 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.virt.hardware [None req-f4839021-304f-410c-beff-09aa89a3603b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 08:37:25.362993 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f4839021-304f-410c-beff-09aa89a3603b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:25.363427 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f4839021-304f-410c-beff-09aa89a3603b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:25.364215 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f4839021-304f-410c-beff-09aa89a3603b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:25.364636 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-f4839021-304f-410c-beff-09aa89a3603b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:25.381536 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-f4839021-304f-410c-beff-09aa89a3603b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Getting quotas for project 28ca19e490b045a8af80ce6bc64afa50. Resources: {'cores', 'instances', 'ram'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 19 08:37:25.385621 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.quota [None req-f4839021-304f-410c-beff-09aa89a3603b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Getting quotas for user 2c83b4f13a67443b90711ef61e4685a6 and project 28ca19e490b045a8af80ce6bc64afa50. Resources: {'cores', 'instances', 'ram'} {{(pid=114105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 19 08:37:25.444070 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-f4839021-304f-410c-beff-09aa89a3603b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Going to run 1 instances... {{(pid=114105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 19 08:37:25.446184 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-f4839021-304f-410c-beff-09aa89a3603b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: dd7c9780-0b3d-4423-9101-38e472ec6dd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6d6f4bd3-1d2b-4758-b221-c4e4e7ac1c74',volume_size=None,volume_type=None)] {{(pid=114105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 19 08:37:25.570650 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-f4839021-304f-410c-beff-09aa89a3603b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.704376 Oct 19 08:37:25.577290 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 791/1625] 10.222.0.26 () {60 vars in 1146 bytes} [Tue Oct 19 08:37:24 2021] POST /compute/v2.1/servers => generated 405 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 08:37:25.581698 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-1d1afd5f-88ad-4fa0-ad5b-01361e4009ac tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:37:25.582513 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-1d1afd5f-88ad-4fa0-ad5b-01361e4009ac tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: dd7c9780-0b3d-4423-9101-38e472ec6dd4] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:37:25.661920 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-1d1afd5f-88ad-4fa0-ad5b-01361e4009ac tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:37:25.669174 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-1d1afd5f-88ad-4fa0-ad5b-01361e4009ac tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4" status: 200 len: 1093 microversion: 2.1 time: 0.091515 Oct 19 08:37:25.669871 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 835/1626] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:37:25 2021] GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4 => generated 1093 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:37:26.687574 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-dbc76b62-26ea-4cbd-a987-f1ecf3885f89 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:37:26.688130 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-dbc76b62-26ea-4cbd-a987-f1ecf3885f89 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: dd7c9780-0b3d-4423-9101-38e472ec6dd4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:37:26.694634 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dbc76b62-26ea-4cbd-a987-f1ecf3885f89 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:26.695087 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dbc76b62-26ea-4cbd-a987-f1ecf3885f89 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:26.695850 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dbc76b62-26ea-4cbd-a987-f1ecf3885f89 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:26.696282 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dbc76b62-26ea-4cbd-a987-f1ecf3885f89 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:26.756836 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-dbc76b62-26ea-4cbd-a987-f1ecf3885f89 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:37:26.764074 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-dbc76b62-26ea-4cbd-a987-f1ecf3885f89 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4" status: 200 len: 1191 microversion: 2.1 time: 0.080462 Oct 19 08:37:26.764613 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 792/1627] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:37:26 2021] GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4 => generated 1191 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:37:27.780999 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-2ce5ca6a-4de7-411c-96c5-cb8e037260b2 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:37:27.781579 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-2ce5ca6a-4de7-411c-96c5-cb8e037260b2 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: dd7c9780-0b3d-4423-9101-38e472ec6dd4] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:37:27.787685 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2ce5ca6a-4de7-411c-96c5-cb8e037260b2 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:27.788123 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2ce5ca6a-4de7-411c-96c5-cb8e037260b2 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:27.788879 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2ce5ca6a-4de7-411c-96c5-cb8e037260b2 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:27.789300 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2ce5ca6a-4de7-411c-96c5-cb8e037260b2 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:27.931901 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-2ce5ca6a-4de7-411c-96c5-cb8e037260b2 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:37:27.939622 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-2ce5ca6a-4de7-411c-96c5-cb8e037260b2 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4" status: 200 len: 1264 microversion: 2.1 time: 0.162368 Oct 19 08:37:27.940501 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 836/1628] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:37:27 2021] GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:37:28.111221 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-b61e4656-bdac-4155-9b71-7fa4e045680e req-98e449c1-a076-4a8a-a799-b51906efc170 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd7c9780-0b3d-4423-9101-38e472ec6dd4", "tag": "145df4ff-19de-412e-8567-2c4aca7c2a1a"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:37:28.112850 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:37:28.112850 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:37:28.119691 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-b61e4656-bdac-4155-9b71-7fa4e045680e req-98e449c1-a076-4a8a-a799-b51906efc170 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:28.120136 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-b61e4656-bdac-4155-9b71-7fa4e045680e req-98e449c1-a076-4a8a-a799-b51906efc170 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:28.131794 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-b61e4656-bdac-4155-9b71-7fa4e045680e req-98e449c1-a076-4a8a-a799-b51906efc170 service nova] Creating event network-changed:145df4ff-19de-412e-8567-2c4aca7c2a1a for instance dd7c9780-0b3d-4423-9101-38e472ec6dd4 on hv-cinder-81398 Oct 19 08:37:28.137272 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-b61e4656-bdac-4155-9b71-7fa4e045680e req-98e449c1-a076-4a8a-a799-b51906efc170 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029969 Oct 19 08:37:28.138274 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 793/1629] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:37:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:37:28.958125 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-7f7ba3c9-e21b-4d99-b67f-892b42f53cce tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:37:28.958680 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-7f7ba3c9-e21b-4d99-b67f-892b42f53cce tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: dd7c9780-0b3d-4423-9101-38e472ec6dd4] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:37:28.964484 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7f7ba3c9-e21b-4d99-b67f-892b42f53cce tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:28.964919 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7f7ba3c9-e21b-4d99-b67f-892b42f53cce tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:28.965701 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7f7ba3c9-e21b-4d99-b67f-892b42f53cce tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:28.966123 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-7f7ba3c9-e21b-4d99-b67f-892b42f53cce tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:29.084095 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-7f7ba3c9-e21b-4d99-b67f-892b42f53cce tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:37:29.091280 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-7f7ba3c9-e21b-4d99-b67f-892b42f53cce tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4" status: 200 len: 1264 microversion: 2.1 time: 0.137975 Oct 19 08:37:29.091842 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 837/1630] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:37:28 2021] GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4 => generated 1264 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:37:30.109172 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-9ff16fb4-fe62-4d0e-af42-44b6f4233a3b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:37:30.109885 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-9ff16fb4-fe62-4d0e-af42-44b6f4233a3b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: dd7c9780-0b3d-4423-9101-38e472ec6dd4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:37:30.116787 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9ff16fb4-fe62-4d0e-af42-44b6f4233a3b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:30.117229 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9ff16fb4-fe62-4d0e-af42-44b6f4233a3b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:30.117981 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9ff16fb4-fe62-4d0e-af42-44b6f4233a3b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:30.118410 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9ff16fb4-fe62-4d0e-af42-44b6f4233a3b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:30.241301 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-9ff16fb4-fe62-4d0e-af42-44b6f4233a3b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:37:30.248483 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-9ff16fb4-fe62-4d0e-af42-44b6f4233a3b tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4" status: 200 len: 1264 microversion: 2.1 time: 0.143587 Oct 19 08:37:30.249050 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 794/1631] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:37:30 2021] GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4 => generated 1264 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:37:31.265063 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-c6b405c3-35d4-40f0-9e0f-cc866e1cb744 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:37:31.265730 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-c6b405c3-35d4-40f0-9e0f-cc866e1cb744 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: dd7c9780-0b3d-4423-9101-38e472ec6dd4] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:37:31.272007 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c6b405c3-35d4-40f0-9e0f-cc866e1cb744 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:31.272452 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c6b405c3-35d4-40f0-9e0f-cc866e1cb744 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:31.273202 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c6b405c3-35d4-40f0-9e0f-cc866e1cb744 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:31.273621 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-c6b405c3-35d4-40f0-9e0f-cc866e1cb744 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:31.390455 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-c6b405c3-35d4-40f0-9e0f-cc866e1cb744 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:37:31.397916 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-c6b405c3-35d4-40f0-9e0f-cc866e1cb744 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4" status: 200 len: 1264 microversion: 2.1 time: 0.136550 Oct 19 08:37:31.398464 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 838/1632] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:37:31 2021] GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4 => generated 1264 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:37:32.415044 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-25cafa78-cc92-4f72-9f24-27f027c9008f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:37:32.415651 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-25cafa78-cc92-4f72-9f24-27f027c9008f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: dd7c9780-0b3d-4423-9101-38e472ec6dd4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:37:32.421712 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-25cafa78-cc92-4f72-9f24-27f027c9008f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:32.422162 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-25cafa78-cc92-4f72-9f24-27f027c9008f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:32.422960 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-25cafa78-cc92-4f72-9f24-27f027c9008f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:32.423393 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-25cafa78-cc92-4f72-9f24-27f027c9008f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:32.614778 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-25cafa78-cc92-4f72-9f24-27f027c9008f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:37:32.621969 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-25cafa78-cc92-4f72-9f24-27f027c9008f tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4" status: 200 len: 1264 microversion: 2.1 time: 0.210684 Oct 19 08:37:32.622578 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 795/1633] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:37:32 2021] GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4 => generated 1264 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:37:33.638734 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-ecbb04c8-13c4-4b4e-a6d0-714fd22979fa tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:37:33.639325 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-ecbb04c8-13c4-4b4e-a6d0-714fd22979fa tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: dd7c9780-0b3d-4423-9101-38e472ec6dd4] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:37:33.645874 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ecbb04c8-13c4-4b4e-a6d0-714fd22979fa tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:33.646308 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ecbb04c8-13c4-4b4e-a6d0-714fd22979fa tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:33.647077 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ecbb04c8-13c4-4b4e-a6d0-714fd22979fa tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:33.647501 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-ecbb04c8-13c4-4b4e-a6d0-714fd22979fa tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:33.764357 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-ecbb04c8-13c4-4b4e-a6d0-714fd22979fa tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:37:33.772940 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-ecbb04c8-13c4-4b4e-a6d0-714fd22979fa tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4" status: 200 len: 1264 microversion: 2.1 time: 0.137867 Oct 19 08:37:33.773488 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 839/1634] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:37:33 2021] GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4 => generated 1264 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:37:34.790336 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-6f74d78b-0a7e-41ab-8648-578da75621e8 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:37:34.790900 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-6f74d78b-0a7e-41ab-8648-578da75621e8 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: dd7c9780-0b3d-4423-9101-38e472ec6dd4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:37:34.796676 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6f74d78b-0a7e-41ab-8648-578da75621e8 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:34.797122 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6f74d78b-0a7e-41ab-8648-578da75621e8 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:34.797884 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6f74d78b-0a7e-41ab-8648-578da75621e8 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:34.798316 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-6f74d78b-0a7e-41ab-8648-578da75621e8 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:34.916195 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-6f74d78b-0a7e-41ab-8648-578da75621e8 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:37:34.923347 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-6f74d78b-0a7e-41ab-8648-578da75621e8 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4" status: 200 len: 1264 microversion: 2.1 time: 0.136794 Oct 19 08:37:34.923904 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 796/1635] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:37:34 2021] GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4 => generated 1264 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:37:35.941318 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-54802622-48bc-4b16-b734-4a78977a1d54 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:37:35.941889 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-54802622-48bc-4b16-b734-4a78977a1d54 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: dd7c9780-0b3d-4423-9101-38e472ec6dd4] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:37:35.947651 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-54802622-48bc-4b16-b734-4a78977a1d54 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:35.948087 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-54802622-48bc-4b16-b734-4a78977a1d54 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:35.948836 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-54802622-48bc-4b16-b734-4a78977a1d54 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:35.949259 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-54802622-48bc-4b16-b734-4a78977a1d54 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:36.067012 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-54802622-48bc-4b16-b734-4a78977a1d54 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:37:36.074024 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-54802622-48bc-4b16-b734-4a78977a1d54 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4" status: 200 len: 1264 microversion: 2.1 time: 0.137100 Oct 19 08:37:36.074589 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 840/1636] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:37:35 2021] GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4 => generated 1264 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:37:37.090695 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-56c4b46e-4861-4a02-8026-5ec7c5a59347 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:37:37.091285 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-56c4b46e-4861-4a02-8026-5ec7c5a59347 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: dd7c9780-0b3d-4423-9101-38e472ec6dd4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:37:37.097610 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-56c4b46e-4861-4a02-8026-5ec7c5a59347 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:37.098053 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-56c4b46e-4861-4a02-8026-5ec7c5a59347 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:37.098865 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-56c4b46e-4861-4a02-8026-5ec7c5a59347 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:37.099293 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-56c4b46e-4861-4a02-8026-5ec7c5a59347 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:37.216176 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-56c4b46e-4861-4a02-8026-5ec7c5a59347 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:37:37.223420 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-56c4b46e-4861-4a02-8026-5ec7c5a59347 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4" status: 200 len: 1264 microversion: 2.1 time: 0.136425 Oct 19 08:37:37.223970 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 797/1637] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:37:37 2021] GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4 => generated 1264 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:37:38.239766 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-9e2fac83-02d7-4c46-abd6-53bcc39e9823 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:37:38.240367 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-9e2fac83-02d7-4c46-abd6-53bcc39e9823 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: dd7c9780-0b3d-4423-9101-38e472ec6dd4] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:37:38.246179 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9e2fac83-02d7-4c46-abd6-53bcc39e9823 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:38.246657 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9e2fac83-02d7-4c46-abd6-53bcc39e9823 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:38.247450 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9e2fac83-02d7-4c46-abd6-53bcc39e9823 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:38.247877 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-9e2fac83-02d7-4c46-abd6-53bcc39e9823 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:38.367232 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-9e2fac83-02d7-4c46-abd6-53bcc39e9823 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:37:38.374392 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-9e2fac83-02d7-4c46-abd6-53bcc39e9823 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4" status: 200 len: 1264 microversion: 2.1 time: 0.138228 Oct 19 08:37:38.374977 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 841/1638] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:37:38 2021] GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4 => generated 1264 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:37:39.391434 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-2335e659-1802-4d70-92c5-f9a2e491afed tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:37:39.392022 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-2335e659-1802-4d70-92c5-f9a2e491afed tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: dd7c9780-0b3d-4423-9101-38e472ec6dd4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:37:39.402234 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2335e659-1802-4d70-92c5-f9a2e491afed tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:39.402234 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2335e659-1802-4d70-92c5-f9a2e491afed tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:39.402234 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2335e659-1802-4d70-92c5-f9a2e491afed tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:39.402234 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-2335e659-1802-4d70-92c5-f9a2e491afed tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:39.518403 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-2335e659-1802-4d70-92c5-f9a2e491afed tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:37:39.525755 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-2335e659-1802-4d70-92c5-f9a2e491afed tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4" status: 200 len: 1264 microversion: 2.1 time: 0.137995 Oct 19 08:37:39.526318 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 798/1639] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:37:39 2021] GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4 => generated 1264 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:37:40.542918 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-76efc3b7-b9c4-453e-8c01-cccd7f6cde9c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:37:40.543520 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-76efc3b7-b9c4-453e-8c01-cccd7f6cde9c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: dd7c9780-0b3d-4423-9101-38e472ec6dd4] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:37:40.549906 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-76efc3b7-b9c4-453e-8c01-cccd7f6cde9c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:40.550342 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-76efc3b7-b9c4-453e-8c01-cccd7f6cde9c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:40.551127 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-76efc3b7-b9c4-453e-8c01-cccd7f6cde9c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:40.551555 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-76efc3b7-b9c4-453e-8c01-cccd7f6cde9c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:40.675013 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-76efc3b7-b9c4-453e-8c01-cccd7f6cde9c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:37:40.682199 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-76efc3b7-b9c4-453e-8c01-cccd7f6cde9c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4" status: 200 len: 1264 microversion: 2.1 time: 0.142946 Oct 19 08:37:40.682792 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 842/1640] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:37:40 2021] GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4 => generated 1264 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:37:41.698820 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-bfec9e47-9122-4262-a758-06370b892913 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:37:41.699363 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-bfec9e47-9122-4262-a758-06370b892913 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: dd7c9780-0b3d-4423-9101-38e472ec6dd4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:37:41.705375 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bfec9e47-9122-4262-a758-06370b892913 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:41.705858 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bfec9e47-9122-4262-a758-06370b892913 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:41.706634 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bfec9e47-9122-4262-a758-06370b892913 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:41.707067 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-bfec9e47-9122-4262-a758-06370b892913 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:41.828633 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-bfec9e47-9122-4262-a758-06370b892913 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:37:41.835906 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-bfec9e47-9122-4262-a758-06370b892913 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4" status: 200 len: 1264 microversion: 2.1 time: 0.140804 Oct 19 08:37:41.836465 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 799/1641] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:37:41 2021] GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4 => generated 1264 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:37:42.602276 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [req-e7c1eb2c-a9f2-4dea-91fa-d6fe3222dcab req-75f36ce8-c7a1-497a-99ef-c726b75eead3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd7c9780-0b3d-4423-9101-38e472ec6dd4", "name": "network-vif-plugged", "status": "completed", "tag": "145df4ff-19de-412e-8567-2c4aca7c2a1a"}]} {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:37:42.603894 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:37:42.603894 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: warnings.warn(msg) Oct 19 08:37:42.612169 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-e7c1eb2c-a9f2-4dea-91fa-d6fe3222dcab req-75f36ce8-c7a1-497a-99ef-c726b75eead3 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:42.612653 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [req-e7c1eb2c-a9f2-4dea-91fa-d6fe3222dcab req-75f36ce8-c7a1-497a-99ef-c726b75eead3 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:42.623862 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.compute.server_external_events [req-e7c1eb2c-a9f2-4dea-91fa-d6fe3222dcab req-75f36ce8-c7a1-497a-99ef-c726b75eead3 service nova] Creating event network-vif-plugged:145df4ff-19de-412e-8567-2c4aca7c2a1a for instance dd7c9780-0b3d-4423-9101-38e472ec6dd4 on hv-cinder-81398 Oct 19 08:37:42.630076 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [req-e7c1eb2c-a9f2-4dea-91fa-d6fe3222dcab req-75f36ce8-c7a1-497a-99ef-c726b75eead3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031423 Oct 19 08:37:42.630721 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 843/1642] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:37:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 08:37:42.852773 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-a7b1f220-0611-4864-9b40-fa970f2296e4 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:37:42.853380 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-a7b1f220-0611-4864-9b40-fa970f2296e4 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: dd7c9780-0b3d-4423-9101-38e472ec6dd4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:37:42.859198 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a7b1f220-0611-4864-9b40-fa970f2296e4 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:42.859640 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a7b1f220-0611-4864-9b40-fa970f2296e4 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:42.860403 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a7b1f220-0611-4864-9b40-fa970f2296e4 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:42.860833 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a7b1f220-0611-4864-9b40-fa970f2296e4 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:42.977131 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-a7b1f220-0611-4864-9b40-fa970f2296e4 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:37:42.984329 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-a7b1f220-0611-4864-9b40-fa970f2296e4 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4" status: 200 len: 1264 microversion: 2.1 time: 0.135201 Oct 19 08:37:42.984890 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 800/1643] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:37:42 2021] GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4 => generated 1264 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:37:44.002929 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-e801e015-500d-4826-96b9-d1bb67c11a8a tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:37:44.003610 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-e801e015-500d-4826-96b9-d1bb67c11a8a tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: dd7c9780-0b3d-4423-9101-38e472ec6dd4] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:37:44.009517 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e801e015-500d-4826-96b9-d1bb67c11a8a tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:44.009951 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e801e015-500d-4826-96b9-d1bb67c11a8a tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:44.010738 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e801e015-500d-4826-96b9-d1bb67c11a8a tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:44.011157 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-e801e015-500d-4826-96b9-d1bb67c11a8a tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:44.135774 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-e801e015-500d-4826-96b9-d1bb67c11a8a tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:37:44.143453 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-e801e015-500d-4826-96b9-d1bb67c11a8a tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4" status: 200 len: 1264 microversion: 2.1 time: 0.144679 Oct 19 08:37:44.144009 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 844/1644] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:37:43 2021] GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4 => generated 1264 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:37:45.160296 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-9936c298-85ae-4ed4-a693-a93c9194613c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:37:45.160913 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-9936c298-85ae-4ed4-a693-a93c9194613c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: dd7c9780-0b3d-4423-9101-38e472ec6dd4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:37:45.166754 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9936c298-85ae-4ed4-a693-a93c9194613c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:45.167193 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9936c298-85ae-4ed4-a693-a93c9194613c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:45.167946 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9936c298-85ae-4ed4-a693-a93c9194613c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:45.168368 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-9936c298-85ae-4ed4-a693-a93c9194613c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:45.284781 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-9936c298-85ae-4ed4-a693-a93c9194613c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:37:45.291859 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-9936c298-85ae-4ed4-a693-a93c9194613c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4" status: 200 len: 1451 microversion: 2.1 time: 0.135722 Oct 19 08:37:45.292409 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 801/1645] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:37:45 2021] GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4 => generated 1451 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:37:45.307617 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-2f717fc0-47e2-4e98-8487-f353c91ae0f1 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:37:45.308245 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-2f717fc0-47e2-4e98-8487-f353c91ae0f1 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: dd7c9780-0b3d-4423-9101-38e472ec6dd4] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:37:45.313856 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2f717fc0-47e2-4e98-8487-f353c91ae0f1 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:45.314292 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2f717fc0-47e2-4e98-8487-f353c91ae0f1 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:45.315961 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2f717fc0-47e2-4e98-8487-f353c91ae0f1 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:45.316389 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2f717fc0-47e2-4e98-8487-f353c91ae0f1 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:45.435036 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-2f717fc0-47e2-4e98-8487-f353c91ae0f1 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:37:45.443157 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-2f717fc0-47e2-4e98-8487-f353c91ae0f1 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4" status: 200 len: 1451 microversion: 2.1 time: 0.139205 Oct 19 08:37:45.443717 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 845/1646] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:37:45 2021] GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4 => generated 1451 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:37:47.160065 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-169eec65-235f-435e-8a51-b1d476328c0f req-2a05ffd0-af1d-4fb2-ac84-eb2477b254e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd7c9780-0b3d-4423-9101-38e472ec6dd4", "tag": "145df4ff-19de-412e-8567-2c4aca7c2a1a"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:37:47.161557 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:37:47.161557 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:37:47.168398 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-169eec65-235f-435e-8a51-b1d476328c0f req-2a05ffd0-af1d-4fb2-ac84-eb2477b254e7 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:37:47.168833 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-169eec65-235f-435e-8a51-b1d476328c0f req-2a05ffd0-af1d-4fb2-ac84-eb2477b254e7 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:37:47.180035 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-169eec65-235f-435e-8a51-b1d476328c0f req-2a05ffd0-af1d-4fb2-ac84-eb2477b254e7 service nova] Creating event network-changed:145df4ff-19de-412e-8567-2c4aca7c2a1a for instance dd7c9780-0b3d-4423-9101-38e472ec6dd4 on hv-cinder-81398 Oct 19 08:37:47.185070 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-169eec65-235f-435e-8a51-b1d476328c0f req-2a05ffd0-af1d-4fb2-ac84-eb2477b254e7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028717 Oct 19 08:37:47.185725 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 802/1647] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:37:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:39:11.882617 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 08:39:11.883082 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: Tue Oct 19 08:39:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 19 08:39:51.144638 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9a5a4159-6059-411d-8c9e-019f3fe5d8cf] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 08:39:51.148457 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: ERROR oslo.messaging._drivers.impl_rabbit [-] [94e1973e-8f05-4377-b6ab-aea34b007747] AMQP server on 10.222.0.26:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Oct 19 08:39:51.148915 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-2f327bff-50d3-4b6f-8f6d-16cfdfffede5 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:39:51.149163 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-2f327bff-50d3-4b6f-8f6d-16cfdfffede5 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: dd7c9780-0b3d-4423-9101-38e472ec6dd4] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:39:51.153062 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-e7ee905c-1a7e-4fc4-9b3e-1ff7e40732b5 req-ad482ede-bed6-446b-89a6-6dab329c9444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd7c9780-0b3d-4423-9101-38e472ec6dd4", "tag": "145df4ff-19de-412e-8567-2c4aca7c2a1a"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:39:51.154725 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:39:51.154725 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:39:51.162219 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-e7ee905c-1a7e-4fc4-9b3e-1ff7e40732b5 req-ad482ede-bed6-446b-89a6-6dab329c9444 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:39:51.162688 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-e7ee905c-1a7e-4fc4-9b3e-1ff7e40732b5 req-ad482ede-bed6-446b-89a6-6dab329c9444 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:39:51.164113 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2f327bff-50d3-4b6f-8f6d-16cfdfffede5 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:39:51.164616 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2f327bff-50d3-4b6f-8f6d-16cfdfffede5 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:39:51.165448 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2f327bff-50d3-4b6f-8f6d-16cfdfffede5 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:39:51.165955 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2f327bff-50d3-4b6f-8f6d-16cfdfffede5 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:39:51.173727 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-e7ee905c-1a7e-4fc4-9b3e-1ff7e40732b5 req-ad482ede-bed6-446b-89a6-6dab329c9444 service nova] Creating event network-changed:145df4ff-19de-412e-8567-2c4aca7c2a1a for instance dd7c9780-0b3d-4423-9101-38e472ec6dd4 on hv-cinder-81398 Oct 19 08:39:51.179460 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-e7ee905c-1a7e-4fc4-9b3e-1ff7e40732b5 req-ad482ede-bed6-446b-89a6-6dab329c9444 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032961 Oct 19 08:39:51.180275 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 803/1648] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:39:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:39:51.191661 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-2f327bff-50d3-4b6f-8f6d-16cfdfffede5 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: dd7c9780-0b3d-4423-9101-38e472ec6dd4] Going to try to terminate instance {{(pid=114106) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 19 08:39:51.276188 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-2f327bff-50d3-4b6f-8f6d-16cfdfffede5 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4" status: 204 len: 0 microversion: 2.1 time: 0.132973 Oct 19 08:39:51.277140 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 846/1649] 10.222.0.26 () {58 vars in 1238 bytes} [Tue Oct 19 08:39:51 2021] DELETE /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 08:39:51.286860 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-46835177-a12f-4474-9a33-7d56a33b211c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:39:51.288149 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-46835177-a12f-4474-9a33-7d56a33b211c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: dd7c9780-0b3d-4423-9101-38e472ec6dd4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:39:51.298391 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-46835177-a12f-4474-9a33-7d56a33b211c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:39:51.298870 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-46835177-a12f-4474-9a33-7d56a33b211c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:39:51.299856 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-46835177-a12f-4474-9a33-7d56a33b211c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:39:51.300290 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-46835177-a12f-4474-9a33-7d56a33b211c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:39:51.622650 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-46835177-a12f-4474-9a33-7d56a33b211c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:39:51.629441 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-46835177-a12f-4474-9a33-7d56a33b211c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4" status: 200 len: 1576 microversion: 2.1 time: 0.347389 Oct 19 08:39:51.630036 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 804/1650] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:39:51 2021] GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4 => generated 1576 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:39:52.648612 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-f75ddbcf-819d-4127-a876-9b9d5426c92c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:39:52.649305 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-f75ddbcf-819d-4127-a876-9b9d5426c92c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: dd7c9780-0b3d-4423-9101-38e472ec6dd4] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:39:52.666304 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f75ddbcf-819d-4127-a876-9b9d5426c92c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:39:52.666700 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f75ddbcf-819d-4127-a876-9b9d5426c92c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:39:52.667464 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f75ddbcf-819d-4127-a876-9b9d5426c92c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:39:52.667887 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f75ddbcf-819d-4127-a876-9b9d5426c92c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:39:52.673596 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO oslo.messaging._drivers.impl_rabbit [-] [9a5a4159-6059-411d-8c9e-019f3fe5d8cf] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 59698. Oct 19 08:39:52.836261 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-f75ddbcf-819d-4127-a876-9b9d5426c92c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:39:52.843389 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-f75ddbcf-819d-4127-a876-9b9d5426c92c tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4" status: 200 len: 1457 microversion: 2.1 time: 0.199089 Oct 19 08:39:52.843936 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 847/1651] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:39:52 2021] GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4 => generated 1457 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:39:53.566935 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-43e5c588-1f58-4054-aec7-fd61f8db0310 req-0ada16cf-4ec7-4991-8f46-10b21ee43812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd7c9780-0b3d-4423-9101-38e472ec6dd4", "name": "network-vif-deleted", "tag": "145df4ff-19de-412e-8567-2c4aca7c2a1a"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:39:53.569061 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:39:53.569061 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:39:53.586197 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-43e5c588-1f58-4054-aec7-fd61f8db0310 req-0ada16cf-4ec7-4991-8f46-10b21ee43812 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:39:53.586646 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-43e5c588-1f58-4054-aec7-fd61f8db0310 req-0ada16cf-4ec7-4991-8f46-10b21ee43812 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:39:53.599505 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-43e5c588-1f58-4054-aec7-fd61f8db0310 req-0ada16cf-4ec7-4991-8f46-10b21ee43812 service nova] Creating event network-vif-deleted:145df4ff-19de-412e-8567-2c4aca7c2a1a for instance dd7c9780-0b3d-4423-9101-38e472ec6dd4 on hv-cinder-81398 Oct 19 08:39:53.604164 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-43e5c588-1f58-4054-aec7-fd61f8db0310 req-0ada16cf-4ec7-4991-8f46-10b21ee43812 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041046 Oct 19 08:39:53.605125 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 805/1652] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:39:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:39:53.861001 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-f29c0e01-06c5-4696-8ee6-09839b8ec7fc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:39:53.861773 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-f29c0e01-06c5-4696-8ee6-09839b8ec7fc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: dd7c9780-0b3d-4423-9101-38e472ec6dd4] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:39:53.868546 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f29c0e01-06c5-4696-8ee6-09839b8ec7fc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:39:53.868990 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f29c0e01-06c5-4696-8ee6-09839b8ec7fc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:39:53.869763 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f29c0e01-06c5-4696-8ee6-09839b8ec7fc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:39:53.870190 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-f29c0e01-06c5-4696-8ee6-09839b8ec7fc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:39:53.934741 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-f29c0e01-06c5-4696-8ee6-09839b8ec7fc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:39:53.946941 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-f29c0e01-06c5-4696-8ee6-09839b8ec7fc tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4" status: 200 len: 1224 microversion: 2.1 time: 0.089607 Oct 19 08:39:53.947625 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 848/1653] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:39:53 2021] GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:39:54.964616 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-a08c271e-bbde-4d6d-a720-b9b1cd3db00e tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:39:54.965295 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-a08c271e-bbde-4d6d-a720-b9b1cd3db00e tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: dd7c9780-0b3d-4423-9101-38e472ec6dd4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:39:54.968896 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO oslo.messaging._drivers.impl_rabbit [-] [94e1973e-8f05-4377-b6ab-aea34b007747] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 59704. Oct 19 08:39:54.972549 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a08c271e-bbde-4d6d-a720-b9b1cd3db00e tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:39:54.972985 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a08c271e-bbde-4d6d-a720-b9b1cd3db00e tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:39:54.973734 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a08c271e-bbde-4d6d-a720-b9b1cd3db00e tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:39:54.974152 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-a08c271e-bbde-4d6d-a720-b9b1cd3db00e tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:39:54.986843 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.wsgi [None req-a08c271e-bbde-4d6d-a720-b9b1cd3db00e tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] HTTP exception thrown: Instance dd7c9780-0b3d-4423-9101-38e472ec6dd4 could not be found. Oct 19 08:39:54.987416 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-a08c271e-bbde-4d6d-a720-b9b1cd3db00e tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Returning 404 to user: Instance dd7c9780-0b3d-4423-9101-38e472ec6dd4 could not be found. {{(pid=114105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:39:54.988214 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-a08c271e-bbde-4d6d-a720-b9b1cd3db00e tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4" status: 404 len: 111 microversion: 2.1 time: 0.027656 Oct 19 08:39:54.988726 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 806/1654] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:39:54 2021] GET /compute/v2.1/servers/dd7c9780-0b3d-4423-9101-38e472ec6dd4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:39:58.015659 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-0d6deebe-0251-48b0-8716-1a63915e1a73 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:39:58.021123 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-c9d1cbe6-a437-4d7e-8c0d-0377b0e74d79 req-8a29fd29-5258-4f7e-b648-a98a62b69fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "532d2be2-d6f6-4402-b37b-574a504d3ab4", "tag": "c2ff330e-a352-4142-beea-72ad324f3271"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:39:58.021917 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-0d6deebe-0251-48b0-8716-1a63915e1a73 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 532d2be2-d6f6-4402-b37b-574a504d3ab4] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:39:58.023099 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:39:58.023099 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:39:58.036635 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-c9d1cbe6-a437-4d7e-8c0d-0377b0e74d79 req-8a29fd29-5258-4f7e-b648-a98a62b69fd2 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:39:58.037007 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-c9d1cbe6-a437-4d7e-8c0d-0377b0e74d79 req-8a29fd29-5258-4f7e-b648-a98a62b69fd2 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:39:58.039379 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0d6deebe-0251-48b0-8716-1a63915e1a73 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:39:58.039868 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0d6deebe-0251-48b0-8716-1a63915e1a73 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:39:58.040657 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0d6deebe-0251-48b0-8716-1a63915e1a73 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:39:58.041089 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-0d6deebe-0251-48b0-8716-1a63915e1a73 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:39:58.048348 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-c9d1cbe6-a437-4d7e-8c0d-0377b0e74d79 req-8a29fd29-5258-4f7e-b648-a98a62b69fd2 service nova] Creating event network-changed:c2ff330e-a352-4142-beea-72ad324f3271 for instance 532d2be2-d6f6-4402-b37b-574a504d3ab4 on hv-cinder-81398 Oct 19 08:39:58.054325 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-c9d1cbe6-a437-4d7e-8c0d-0377b0e74d79 req-8a29fd29-5258-4f7e-b648-a98a62b69fd2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036916 Oct 19 08:39:58.055039 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 807/1655] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:39:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:39:58.069057 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-0d6deebe-0251-48b0-8716-1a63915e1a73 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 532d2be2-d6f6-4402-b37b-574a504d3ab4] Going to try to terminate instance {{(pid=114106) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 19 08:39:58.149388 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-0d6deebe-0251-48b0-8716-1a63915e1a73 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "DELETE /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4" status: 204 len: 0 microversion: 2.1 time: 0.136652 Oct 19 08:39:58.150458 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 849/1656] 10.222.0.26 () {58 vars in 1238 bytes} [Tue Oct 19 08:39:58 2021] DELETE /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 08:39:58.159446 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-66c14330-c693-4dc3-b114-773c77216524 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:39:58.160143 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-66c14330-c693-4dc3-b114-773c77216524 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 532d2be2-d6f6-4402-b37b-574a504d3ab4] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:39:58.168836 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-66c14330-c693-4dc3-b114-773c77216524 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:39:58.169287 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-66c14330-c693-4dc3-b114-773c77216524 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:39:58.170072 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-66c14330-c693-4dc3-b114-773c77216524 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:39:58.170573 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-66c14330-c693-4dc3-b114-773c77216524 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:39:58.376390 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.policy [None req-66c14330-c693-4dc3-b114-773c77216524 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114105) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:39:58.381399 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-66c14330-c693-4dc3-b114-773c77216524 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4" status: 200 len: 1577 microversion: 2.1 time: 0.226147 Oct 19 08:39:58.382210 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 808/1657] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:39:58 2021] GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4 => generated 1577 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:39:59.399596 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-b5c3110e-6b8a-4f81-89d1-1a32b177fdf2 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:39:59.400311 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-b5c3110e-6b8a-4f81-89d1-1a32b177fdf2 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 532d2be2-d6f6-4402-b37b-574a504d3ab4] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:39:59.406023 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b5c3110e-6b8a-4f81-89d1-1a32b177fdf2 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:39:59.406461 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b5c3110e-6b8a-4f81-89d1-1a32b177fdf2 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:39:59.407246 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b5c3110e-6b8a-4f81-89d1-1a32b177fdf2 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:39:59.407670 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-b5c3110e-6b8a-4f81-89d1-1a32b177fdf2 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:39:59.468622 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.policy [None req-b5c3110e-6b8a-4f81-89d1-1a32b177fdf2 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c83b4f13a67443b90711ef61e4685a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ca19e490b045a8af80ce6bc64afa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114106) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:39:59.476354 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-b5c3110e-6b8a-4f81-89d1-1a32b177fdf2 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4" status: 200 len: 1225 microversion: 2.1 time: 0.081523 Oct 19 08:39:59.476957 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 850/1658] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:39:59 2021] GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:40:00.070214 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [req-c1fdbe66-4856-4702-a02b-ebbccd396efa req-9d5ef8b0-a036-42d1-bfa8-d8c20beb6762 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "532d2be2-d6f6-4402-b37b-574a504d3ab4", "name": "network-vif-deleted", "tag": "c2ff330e-a352-4142-beea-72ad324f3271"}]} {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:40:00.071727 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 08:40:00.071727 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: warnings.warn(msg) Oct 19 08:40:00.078532 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-c1fdbe66-4856-4702-a02b-ebbccd396efa req-9d5ef8b0-a036-42d1-bfa8-d8c20beb6762 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:40:00.078971 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [req-c1fdbe66-4856-4702-a02b-ebbccd396efa req-9d5ef8b0-a036-42d1-bfa8-d8c20beb6762 service nova] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:40:00.089989 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.compute.server_external_events [req-c1fdbe66-4856-4702-a02b-ebbccd396efa req-9d5ef8b0-a036-42d1-bfa8-d8c20beb6762 service nova] Creating event network-vif-deleted:c2ff330e-a352-4142-beea-72ad324f3271 for instance 532d2be2-d6f6-4402-b37b-574a504d3ab4 on hv-cinder-81398 Oct 19 08:40:00.094648 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [req-c1fdbe66-4856-4702-a02b-ebbccd396efa req-9d5ef8b0-a036-42d1-bfa8-d8c20beb6762 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028682 Oct 19 08:40:00.095204 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 809/1659] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 19 08:40:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 08:40:00.494684 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-213769e5-6c3d-4bc6-be14-d74a94caf097 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:40:00.495308 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-213769e5-6c3d-4bc6-be14-d74a94caf097 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 532d2be2-d6f6-4402-b37b-574a504d3ab4] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:40:00.501123 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-213769e5-6c3d-4bc6-be14-d74a94caf097 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:40:00.501560 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-213769e5-6c3d-4bc6-be14-d74a94caf097 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:40:00.502300 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-213769e5-6c3d-4bc6-be14-d74a94caf097 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:40:00.502752 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-213769e5-6c3d-4bc6-be14-d74a94caf097 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:40:00.517512 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.wsgi [None req-213769e5-6c3d-4bc6-be14-d74a94caf097 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] HTTP exception thrown: Instance 532d2be2-d6f6-4402-b37b-574a504d3ab4 could not be found. Oct 19 08:40:00.518316 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-213769e5-6c3d-4bc6-be14-d74a94caf097 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Returning 404 to user: Instance 532d2be2-d6f6-4402-b37b-574a504d3ab4 could not be found. {{(pid=114106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:40:00.519358 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-213769e5-6c3d-4bc6-be14-d74a94caf097 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4" status: 404 len: 111 microversion: 2.1 time: 0.028430 Oct 19 08:40:00.519926 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 851/1660] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:40:00 2021] GET /compute/v2.1/servers/532d2be2-d6f6-4402-b37b-574a504d3ab4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:40:00.957670 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-dc2df503-7f6c-49bd-803c-fa3be1a58971 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:40:00.958408 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.compute.api [None req-dc2df503-7f6c-49bd-803c-fa3be1a58971 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114105) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:40:00.964403 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dc2df503-7f6c-49bd-803c-fa3be1a58971 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:40:00.964855 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dc2df503-7f6c-49bd-803c-fa3be1a58971 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:40:00.965615 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dc2df503-7f6c-49bd-803c-fa3be1a58971 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:40:00.966048 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG oslo_concurrency.lockutils [None req-dc2df503-7f6c-49bd-803c-fa3be1a58971 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:40:00.979418 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.wsgi [None req-dc2df503-7f6c-49bd-803c-fa3be1a58971 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] HTTP exception thrown: Instance 9802a026-2641-4cdf-9d05-97a5272d6d8b could not be found. Oct 19 08:40:00.979926 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-dc2df503-7f6c-49bd-803c-fa3be1a58971 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Returning 404 to user: Instance 9802a026-2641-4cdf-9d05-97a5272d6d8b could not be found. {{(pid=114105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:40:00.980731 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-dc2df503-7f6c-49bd-803c-fa3be1a58971 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 404 len: 111 microversion: 2.1 time: 0.027457 Oct 19 08:40:00.981250 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 810/1661] 10.222.0.26 () {58 vars in 1238 bytes} [Tue Oct 19 08:40:00 2021] DELETE /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:40:00.989762 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-2ce28a48-7398-4539-a699-012a6d72a467 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '>' {{(pid=114106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:40:00.990457 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.compute.api [None req-2ce28a48-7398-4539-a699-012a6d72a467 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] [instance: 9802a026-2641-4cdf-9d05-97a5272d6d8b] Fetching instance by UUID {{(pid=114106) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 19 08:40:00.996242 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2ce28a48-7398-4539-a699-012a6d72a467 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:40:00.996687 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2ce28a48-7398-4539-a699-012a6d72a467 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:40:00.997443 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2ce28a48-7398-4539-a699-012a6d72a467 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 19 08:40:00.997871 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG oslo_concurrency.lockutils [None req-2ce28a48-7398-4539-a699-012a6d72a467 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Lock "6604bbba-8828-47eb-a883-0d318e12f828" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 19 08:40:01.011029 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.wsgi [None req-2ce28a48-7398-4539-a699-012a6d72a467 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] HTTP exception thrown: Instance 9802a026-2641-4cdf-9d05-97a5272d6d8b could not be found. Oct 19 08:40:01.011609 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: DEBUG nova.api.openstack.wsgi [None req-2ce28a48-7398-4539-a699-012a6d72a467 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Returning 404 to user: Instance 9802a026-2641-4cdf-9d05-97a5272d6d8b could not be found. {{(pid=114106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 19 08:40:01.012406 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO nova.api.openstack.requestlog [None req-2ce28a48-7398-4539-a699-012a6d72a467 tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b" status: 404 len: 111 microversion: 2.1 time: 0.026887 Oct 19 08:40:01.012921 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: [pid: 114106|app: 0|req: 852/1662] 10.222.0.26 () {58 vars in 1235 bytes} [Tue Oct 19 08:40:00 2021] GET /compute/v2.1/servers/9802a026-2641-4cdf-9d05-97a5272d6d8b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 08:40:02.307856 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: DEBUG nova.api.openstack.wsgi [None req-d3ec597a-30b1-4a4a-8f8b-cc2eb3a776fe tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] Calling method '.version_select at 0x7fcadd0f7790>' {{(pid=114105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:40:02.327896 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO nova.api.openstack.requestlog [None req-d3ec597a-30b1-4a4a-8f8b-cc2eb3a776fe tempest-TestVolumeBootPattern-881414715 tempest-TestVolumeBootPattern-881414715-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-200438871" status: 202 len: 0 microversion: 2.1 time: 0.023822 Oct 19 08:40:02.328632 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: [pid: 114105|app: 0|req: 811/1663] 10.222.0.26 () {58 vars in 1259 bytes} [Tue Oct 19 08:40:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-200438871 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:42:13.821868 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 08:42:13.822457 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: Tue Oct 19 08:42:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 19 08:42:29.850885 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 08:42:29.851418 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: Tue Oct 19 08:42:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 19 08:42:31.900857 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 08:42:31.901348 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: Tue Oct 19 08:42:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 19 08:42:35.973939 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 08:42:35.974527 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: Tue Oct 19 08:42:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 19 08:42:51.149957 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 08:42:51.150612 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: Tue Oct 19 08:42:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 19 08:42:54.723442 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 08:42:54.723977 dv-cinder-813984-3-iscsi devstack@n-api.service[114105]: Tue Oct 19 08:42:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 19 08:45:33.841122 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 08:45:33.842139 dv-cinder-813984-3-iscsi devstack@n-api.service[114106]: Tue Oct 19 08:45:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!